Papers with sentiment analysis
Copied to clipboard
| Challenge: | Latent structure models are a powerful tool for compositional data modeling and pipelines. |
| Approach: | This tutorial will cover recent advances in discrete latent structure models . it will discuss their motivation, potential, and limitations . |
| Outcome: | This tutorial will cover recent advances in discrete latent structure models . it will discuss their motivation, potential, and limitations . |
Copied to clipboard
| Challenge: | a tutorial focuses on computational models for conversational structure, summarization and sentiment detection, and group dynamics. |
| Approach: | a tutorial will provide examples of specific NLP tasks for conversational structure, summarization and sentiment detection, and group dynamics. |
| Outcome: | The tutorial focuses on the three areas of conversational structure, summarization and sentiment detection, and group dynamics. |
Copied to clipboard
| Challenge: | Negation resolution remains an acute and continuously researched question in Natural Language Processing. |
| Approach: | They propose to use multilingual pre-trained general representation models to detect negation scope in languages without annotated data. |
| Outcome: | The proposed model achieves token-level F1 score between English, Spanish, French, and Russian. |
Copied to clipboard
| Challenge: | NLP Workbench is a web-based text mining platform that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. |
| Approach: | They propose to use a microservice architecture to replace existing models or integrate a new one. |
| Outcome: | The proposed model is extensible and can be easily replaced or integrated with existing models. |
Copied to clipboard
| Challenge: | Existing methods to train ABSA model are limited by lack of annotated data . a dual-granularity pseudo labeling approach is proposed to solve this problem . |
| Approach: | They propose a framework for aspect-based sentiment analysis that uses annotated data to train ABSA models. |
| Outcome: | The proposed framework surpasses previous methods on benchmarks. |
Copied to clipboard
| Challenge: | Discourse processing is a suite of NLP tasks to uncover linguistic structures from texts at several levels, which can support many downstream applications. |
| Approach: | They present a set of tasks to uncover linguistic structures from texts at several levels, which can support many downstream applications. |
| Outcome: | The tutorial covers the basic concepts of discourse analysis and linguistic structures in monologue vs. conversation, synchronous v. asynchronous conversation, and key linguistic structure in discourse analysis. |
Copied to clipboard
| Challenge: | a new tool to detect sexism on social media platforms is being developed to identify such behavior . sexist ideologies such as sextism and gender-based violence can be spread through social media . |
| Approach: | They propose to use BERT and GraphSAGE to analyze tweets for sexism detection . they also use sentiment analysis and natural language processing techniques to classify tweets . |
| Outcome: | The proposed tool analyzes tweets for sexism detection and classifies them into five categories. |
Copied to clipboard
| Challenge: | a recent study shows that annotating sentiments is difficult and difficult. |
| Approach: | They propose to integrate holder and expression information into sentiment analysis to improve target extraction . they perform experiments on eight English datasets to determine whether annotating expressions improves target extraction. |
| Outcome: | The proposed approach improves target extraction and classification on English datasets. |
Copied to clipboard
| Challenge: | Emotion stimulus detection is the task of finding the cause of an emotion in a textual description. |
| Approach: | They propose to evaluate whether clause classification or token sequence labeling is better for emotion stimulus detection in English. |
| Outcome: | The proposed framework compares clause classification and token sequence labeling on four English datasets. |
Copied to clipboard
| Challenge: | Money laundering (AML) is the process of transferring criminal and illegal proceeds into ostensibly legitimate assets. |
| Approach: | They propose a framework that uses deep learning to augment AML monitoring and investigation . money laundering is the process of transferring criminal and illegal proceeds into ostensibly legitimate assets . |
| Outcome: | The proposed framework reduces time and cost by 30% compared to existing methods . money laundering is the world's third largest "industry" |
Copied to clipboard
| Challenge: | Argument mining is a rapidly growing area of research and research that has seen significant growth over the past few years. |
| Approach: | Argument mining is a new area of research that uses opinion mining to extract opinions . the 6th ACL workshop on argument mining will be in Florence in 2019 . |
| Outcome: | Argument mining is a new area of research and development that has seen significant growth in the past three years. |
Copied to clipboard
| Challenge: | Student Evaluations of Teaching (SETs) are used in colleges and universities to assess student perceptions about their courses. |
| Approach: | They propose a system that leverages sentiment analysis, aspect extraction, summarization and visualization techniques to provide organized illustrations of SET findings to instructors and other reviewers. |
| Outcome: | The proposed system can be used by 10 professors from diverse departments to analyze SET results. |
Copied to clipboard
| Challenge: | a recent study shows that sentiment analysis datasets lack context in which an opinion was expressed and are limited by a few emotion categories. |
| Approach: | They propose to ground an LLM-based model into a corpus of narratives to generate stories-character-centered utterances with unique contexts over 28 emotion classes. |
| Outcome: | The proposed model generates non-repetitive story-character-centered utterances with unique contexts over 28 emotion classes. |
Copied to clipboard
| Challenge: | Recent work on ABSA in Urdu language has limitations. |
| Approach: | They propose to create a dataset for Aspect Based Sentiment Analysis in Urdu language which will support multiple aspects. |
| Outcome: | The proposed dataset will provide a baseline evaluation for ABSA systems in Urdu language. |
Copied to clipboard
| Challenge: | Existing deep neural network models lack mechanisms to highlight important sentiment terms. |
| Approach: | They propose a method to incorporate affective knowledge into deep neural network models by mapping affective influence vectors to an affective impact value and integrating them into long-term memory models to highlight affective terms. |
| Outcome: | The proposed approach improves on three large datasets by 1.0% to 1.5% on the benchmark datasets. |
Copied to clipboard
| Challenge: | Existing sentiment analysis models lack temporal information to capture semantics of long texts. |
| Approach: | They propose a framework to exploit task-related discourse structures for sentiment analysis. |
| Outcome: | The proposed framework improves the performance even beyond existing approaches based on human annotated data. |
Copied to clipboard
| Challenge: | Automated Essay Scoring (AES) is a process that aims to alleviate the workload of graders and improve the feedback cycle in educational systems. |
| Approach: | They propose to combine two tasks, sentiment analysis and AES by utilizing multi-task learning to combine sentiment features extracted from opinion expressions. |
| Outcome: | The proposed model produces a QWK of 0.763 on the Automated StudentAssessment Prize (ASAP) benchmark. |
Copied to clipboard
| Challenge: | BLEU: MT is a very robust and efficient way to translate user-generated content. |
| Approach: | They propose a task to encourage research on MT robustness and domain adaptation . they ask professionals to translate 11.5k french 4SQ reviews to English . |
| Outcome: | The proposed task improves on the existing MT systems in a real-world scenario . the proposed methods improve translation accuracy and sentiment analysis . |
Copied to clipboard
| Challenge: | Existing methods that extract features from input text to explain a classifier's prediction are limiting to models that are faithful to their predictions. |
| Approach: | They propose a framework for guiding model explanations by supervising them explicitly using task-related lexicons to direct supervise model explanation. |
| Outcome: | The proposed method improves model explanations without sacrificing performance on sentiment analysis and toxicity detection tasks while demoting spurious correlations with African American English dialects. |
Copied to clipboard
| Challenge: | Indic languages are resource-scarce and do not have such parallel data due to low volume of queries. |
| Approach: | They propose a sequence-to-sequence deep learning model which trains end-to end for Indic languages, Hindi and Telugu. |
| Outcome: | The proposed model is competitive with existing spell checking and correction techniques for Indic languages. |
Copied to clipboard
| Challenge: | Multimodal sentiment analysis is a trending area of research, and multimodal fusion is one of its most active topics. |
| Approach: | They propose to use modality-based penalties to measure dependency between models to improve accuracy. |
| Outcome: | The proposed methods improve accuracy on two well-known sentiment analysis datasets by 4.3 on the proposed models and by-product includes a statistical network which can interpret the high dimensional representations learnt by the model. |
Copied to clipboard
| Challenge: | Existing methods for sentiment analysis are difficult to assess for erroneous predictions that might exist prior to deployment. |
| Approach: | They propose a framework for error detection based on explainable features that can detect erroneous model predictions on unseen data with high precision. |
| Outcome: | The proposed framework detects erroneous model predictions on unseen data with high precision, given limited human-in-the-loop intervention, and can be deployed on unselected data with a high accuracy. |
Copied to clipboard
| Challenge: | Recent work has shown large language models are adept at text generation and fine-tuning for downstream NLP tasks. |
| Approach: | They propose a system that generates paraphrased examples in autoregressive fashion using a neural network without the need for techniques such as top-k word selection or beam search. |
| Outcome: | The proposed system generates paraphrased examples in autoregressive fashion without the need for techniques such as top-k word selection or beam search. |
Copied to clipboard
| Challenge: | Social distancing orders are the most effective strategy to reduce the spread of COVID-19 in 2020 . |
| Approach: | They propose to use NLP methods in a causal mediation scenario to emphasize the use of NLP and economics to decouple the effect of government restrictions on mobility from the effect that occurs due to public perception of the COVID-19 strategy. |
| Outcome: | The proposed model decouples the effect of government restrictions on mobility behavior from the effect that occurs due to public perception of the COVID-19 strategy in a country. |
Copied to clipboard
| Challenge: | Detecting user frustration in task-oriented dialog systems is imperative for maintaining overall user satisfaction, engagement and retention. |
| Approach: | They compare out-of-the-box methods for user frustration detection with open-source methods . they find an LLM-based approach is promising, as it captures both emotion and dialog breakdowns . |
| Outcome: | The proposed method outperforms open-source methods in detecting user frustration in a TOD system. |
Copied to clipboard
| Challenge: | Existing models for sentiment analysis over tweets require a substantial amount of text to adapt to a domain where the syntax is different. |
| Approach: | They propose to use a multilingual transformer model to train over tweets in five different languages to adapt the model to non-English languages. |
| Outcome: | The proposed model improves over small corpora of tweets in non-English languages. |
Copied to clipboard
| Challenge: | Recent work has shown that explanation techniques can be unstable and can be manipulated to hide the actual reasoning behind the predictions of NLP models. |
| Approach: | They propose to merge a BERT-based sentiment classifier with a Facade Model that overwhelms the gradients without affecting the predictions. |
| Outcome: | The proposed model overwhelms the gradients without affecting the predictions on a variety of NLP tasks, such as sentiment analysis, NLI, and QA. |
Copied to clipboard
| Challenge: | Low-resource languages (LRLs) face significant challenges in natural language processing due to limited data. |
| Approach: | They evaluate adapter-based methods for adapting mLMs to low-resource languages . they use unstructured text and structured knowledge from ConceptNet to evaluate adapters . |
| Outcome: | The proposed methods outperform large language models and LLaMA-3 and deepSeek-R1 models on low training data. |
Copied to clipboard
| Challenge: | Contemporary datasets on tobacco consumption focus on one of two topics, public health mentions and disease surveillance, or sentiment analysis on topical tobacco products and services. |
| Approach: | They propose to use a dataset of 3144 tweets to analyze slang related to smoking and then use it to create a binary and multi-class classification mechanism. |
| Outcome: | The proposed method is able to identify a topic, a general mention or a more fine-grained classification based on the semantics of the tweets. |
Copied to clipboard
| Challenge: | a large upfront infrastructure investment makes machine learning models difficult to deploy . however, serverless architectures have strict limits on the size of the deployment package . |
| Approach: | They propose to fine-tune BERT-style models on proprietary datasets for tasks . they use knowledge distillation to obtain models that are tuned for a specific domain . |
| Outcome: | The proposed model deployments report acceptable latency levels and cost-effectiveness without infrastructure overhead. |
Copied to clipboard
| Challenge: | End-to-end aspect-based sentiment analysis uses two sub-tasks to extract aspect terms . experimental results demonstrate the effectiveness of our approach on all datasets . |
| Approach: | They propose to combine aspect extraction and sentiment analysis with encoding syntactic information to improve model's representation of input sentences. |
| Outcome: | The proposed approach achieves state-of-the-art on three benchmark datasets. |
Copied to clipboard
| Challenge: | Recent advances in NLP, such as large language models, have had groundbreaking impact on the field. |
| Approach: | They propose a benchmark for Belarusian, an East Slavic language, with 15K instances in five tasks: sentiment analysis, linguistic acceptability, word in context, Winograd schema challenge, textual entailment. |
| Outcome: | The proposed model underperforms on sentiment analysis, linguistic acceptability, word in context, Winograd schema challenge and textual entailment, but is competitive for linguistic acceptance. |
Copied to clipboard
| Challenge: | Existing representational frameworks for emotion encoding are incompatible with semantic polarity, resulting in a large amount of incompatible emotion lexicons. |
| Approach: | They propose to map different emotion representation formats onto each other for mutual compatibility and interoperability of language resources. |
| Outcome: | The proposed method produces (near-)gold quality emotion lexicons even in crosslingual settings. |
Copied to clipboard
| Challenge: | Existing methods for interpreting transformer outputs are scattered and hard to operationalize. |
| Approach: | They propose a Python library to simplify the use and comparisons of XAI methods on transformers. |
| Outcome: | The proposed method provides better explanations and is preferable in the context of transformer models. |
Copied to clipboard
| Challenge: | Empirical results show the efficacy of our proposed multi-task framework over existing state-of-the-art systems. |
| Approach: | They propose a multi-task, multi-modal deep learning framework to solve multiple tasks simultaneously. |
| Outcome: | The proposed framework performs better than existing state-of-the-art systems on a complicated form of information, i.e., memes. |
Copied to clipboard
| Challenge: | Zero-shot cross-lingual transfer learning has been shown to be challenging for tasks involving a lot of linguistic specificities or when a cultural gap is present between languages, such as hate speech detection. |
| Approach: | They propose to train on multilingual auxiliary tasks to improve zero-shot transfer of hate speech detection models across languages by bringing a cross-lingual knowledge proxy to the task. |
| Outcome: | The proposed methods improve zero-shot transfer of hate speech detection models across languages and domains using multilingual auxiliary tasks fine-tuned. |
Copied to clipboard
| Challenge: | Existing frameworks for generating personalized reviews take privacy and fairness into account . users generate digital footprints when "traveling" on the internet . |
| Approach: | They propose a neural-based framework that generates personalized reviews with privacy and fairness in mind. |
| Outcome: | The proposed framework generates plausibly long reviews while controlling the amount of exploited user data and using the least sentiment biased embeddings. |
Copied to clipboard
| Challenge: | Emotion Masked Language Modelling improves the performance of a pretraining language model for emotion detection and sentiment analysis tasks. |
| Approach: | They propose a BERT-based version of Masked Language Modelling that induces emotion into the model. |
| Outcome: | The proposed model improves on emotion detection and sentiment analysis tasks by 1.2% F-1 . the proposed model also shows increased robustness in the test. |
Copied to clipboard
| Challenge: | Negation scope detection is a supervised learning task which relies on negation labels at word level. |
| Approach: | They propose a method that replaces world-level negation labels with document-level sentiment annotations. |
| Outcome: | The proposed approach eliminates the need for world-level negation labels and replaces it with document-level sentiment annotations. |
Copied to clipboard
| Challenge: | Existing methods for sentiment analysis are inconsistent and require manual processing. |
| Approach: | They use natural language processing and machine learning to classify Yelp reviews' sentiments. |
| Outcome: | The proposed model outperforms other models on Yelp reviews. |
Copied to clipboard
| Challenge: | Existing methods for fine-tuning on indistribution data fail to provide robustness against distribution shifts limiting the practical deployment of LLMs in dynamic real-world scenarios. |
| Approach: | They propose a method that leverages the flexibility of LLMs to align both in-distribution (ID) and OOD data with the LLM's distributions. |
| Outcome: | The proposed method outperforms fine-tuning methods on OOD tasks and benchmark datasets. |
Copied to clipboard
| Challenge: | Sentiment analysis is a field that is growing due to the availability of the Internet and the growing number of online platforms. |
| Approach: | They propose an annotated Turkish dataset suitable for targeted sentiment analysis. |
| Outcome: | The proposed models outperform the traditional models for the targeted sentiment analysis task. |
Copied to clipboard
| Challenge: | Existing defense mechanisms assume that only one type of trigger is adopted by the attacker, while defending against multiple simultaneous and independent trigger types necessitates general defense frameworks. |
| Approach: | They propose a framework that uses a mixture of experts as a trigger-only ensemble to defend against multiple trigger types. |
| Outcome: | The proposed framework defends against multiple trigger types in a single ensemble and in combination of models. |
Copied to clipboard
| Challenge: | skweak is a Python-based toolkit for NLP developers to use weak supervision . labelled data remains a scarce resource in many practical NLP scenarios . |
| Approach: | They present a Python-based toolkit that allows NLP developers to use weak supervision . skweak is designed to facilitate the use of weak supervision for NLP tasks . |
| Outcome: | skweak is a Python-based toolkit that facilitates weak supervision . the toolkit provides a simple interface to apply labels to a large corpus of text data . |
Copied to clipboard
| Challenge: | Existing sentiment analysis systems are prone to word shortening, exaggeration, lack of grammar and appropriate punctuation. |
| Approach: | They propose a two-layered attention network based on Bidirectional Long Short-Term Memory for sentiment analysis using the Knowledge Graph Embedding generated using the WordNet. |
| Outcome: | The proposed model outperforms the state-of-the-art system on the benchmark dataset of SemEval 2017 Task 5 by 1.7 and 3.7 points respectively. |
Copied to clipboard
| Challenge: | Text in domains like social media has its own salient characteristics. |
| Approach: | They propose a method to obtain domain knowledge and integrate it with general knowledge to improve emotion classification. |
| Outcome: | The proposed method improves performance of emotion classification on Twitter data. |
Copied to clipboard
| Challenge: | Existing frameworks for sequence labeling and classification require massive human effort and labeling data is limited. |
| Approach: | They propose a web-based, Label-Efficient AnnotatioN framework that allows an annotator to provide the needed labels for a task and can capture explanations for each labeling decision. |
| Outcome: | The proposed framework surpasses baseline F1 scores by 5-10 percentage points while using 2X times fewer labeled instances. |
Copied to clipboard
| Challenge: | Word embeddings do not capture affective dimensions of valence, arousal, and dominance . valency, valance, and adolescence are present in words, but are not represented in text . |
| Approach: | They propose a method for updating word embeddings for affective meaning . they use a non-linear transformation function that maps pre-trained embedders to an affective vector space . |
| Outcome: | The proposed method improves inter-cluster and intra-c cluster distances for emotion-bearing words. |
Copied to clipboard
| Challenge: | sarcasm, humor, hate speech, and sentiment are a complex language attribute . sentiment classification models are used for complex language understanding tasks . |
| Approach: | They propose a two-step model that extracts features pertaining to sarcasm, humour, hate speech, as well as sentiment from online reviews and feeds them to inform sentiment classification. |
| Outcome: | The proposed model improves on sarcasm, humor, hate speech and sentiment classification . it can be combined with other models to achieve similar results . |
Copied to clipboard
| Challenge: | Existing methods to predict treatment outcome are limited to text categorisation, but they can be applied to patient texts. |
| Approach: | They propose to use patient text as the only signal for predicting treatment outcome in Internet-based cognitive behavioural therapy for depression, social anxiety, and panic disorder. |
| Outcome: | The proposed method beats stratified random guessing by using a simple Bag of Words to predict treatment success and failure. |
Copied to clipboard
| Challenge: | Existing online backdoor defense methods for NLP models focus on anomalies at input or output level, causing fragility to adaptive attacks and high computational cost. |
| Approach: | They propose a feature-based online defense method to detect poisoned samples . they use a distance-based anomaly score to distinguish poisones from clean samples based on feature-level regularization . |
| Outcome: | The proposed method outperforms existing methods in sentiment analysis and offense detection tasks. |
Copied to clipboard
| Challenge: | Pre-trained language models have been widely applied to cross-domain NLP tasks like sentiment analysis, but fine-tuning them on the source domain tends to overfit, leading to inferior results on the target domain. |
| Approach: | They propose to pre-train a sentiment-aware language model (SentiX) via domain-invariant sentiment knowledge from large-scale review datasets and utilize it for cross-domain sentiment analysis tasks without fine-tuning. |
| Outcome: | The proposed model achieves state-of-the-art in all the cross-domain sentiment analysis tasks and can be trained with only 1% samples and better than BERT with 90% samples. |
Copied to clipboard
| Challenge: | Training data for sentiment analysis is abundant in multiple domains, yet scarce for other domains. |
| Approach: | They propose to use domain-specific representations of input sentences to improve sentiment classification . they use a descriptor vector to map adversarially trained domain-general Bi-LSTM inputs into domain- specific representations . |
| Outcome: | The proposed model outperforms existing methods on multi-domain sentiment analysis significantly. |
Copied to clipboard
| Challenge: | Existing approaches to target sentiment analysis are limited by huge search space and sentiment inconsistency. |
| Approach: | They propose a span-based extract-then-classify framework to detect opinion targets . they propose pipeline, joint, and collapsed models to classify polarities . |
| Outcome: | The proposed framework outperforms the sequence tagging baseline on three benchmark datasets. |
Copied to clipboard
| Challenge: | Arabizi is a written form of spoken Arabic, relying on Latin characters and digits. |
| Approach: | They propose to use Arabizi as a written form of spoken Arabic in online social networks . they use a corpus of 7.7M tweets written in Arabizi and a subset of SALAD to train a model in Arabic . |
| Outcome: | The proposed model outperforms state-of-the-art models on sentiment analysis task using arabizi . the proposed model is based on a corpus of 7.7M tweets written in arabizi and a subset of LAD manually annotated for sentiment analysis. |
Copied to clipboard
| Challenge: | Identifying the stance of an argument towards a topic is a fundamental problem in computational argumentation. |
| Approach: | They propose a task where text users are asked to determine if they have the same sentiment . they aim to enable a more topic-agnostic sentiment classification by using Yelp data . |
| Outcome: | The proposed task achieves an accuracy above 83% for category subsets across topics and 89% on average. |
Copied to clipboard
| Challenge: | Large language models lack task-specific alignment with ASQP . supervised small language models (SLMs) lack the extensive knowledge of LLMs. |
| Approach: | They propose a framework that combines large language models and small language models to align LLM outputs with human preferences. |
| Outcome: | The proposed framework improves Aspect Sentiment Quad Prediction performance by combining SLMs and LLMs. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are limited in low-resource languages due to lack of labeled training data. |
| Approach: | They propose to use Ladin as a model for sentiment analysis and question answering by incorporating Italian data into machine translation training. |
| Outcome: | The proposed method improves on existing Italian–Ladin translation baselines. |
Copied to clipboard
| Challenge: | Pre-trained language models are often used to achieve state-of-the-art results . eval paper shows that generative language model can handle joint and multi-task settings . |
| Approach: | They propose to reformulate extraction and prediction tasks into a sequence generation task . they propose a generative language model with unidirectional attention that learns to accomplish the tasks via language generation . |
| Outcome: | The proposed model outperforms the state-of-the-art in few-shot and full-shot settings. |
Copied to clipboard
| Challenge: | Existing work has failed to acknowledge that what counts as a rationale is subjective. |
| Approach: | They propose to use demographic annotations to augment existing datasets to ask what demographics our models align with and whose reasoning patterns they align with. |
| Outcome: | The proposed model rationales align better with older and/or white annotators, and are biased towards older and white anorators. |
Copied to clipboard
| Challenge: | Existing evaluation paradigms for behavioral learning use correlations in training data, but they ignore important model properties such as fairness. |
| Approach: | They propose an analysis method for evaluating behavioral learning considering generalization across dimensions of different granularity levels. |
| Outcome: | The proposed method optimizes behavior-specific loss functions and evaluates models on several partitions of the behavioral test suite controlled to leave out specific phenomena. |
Copied to clipboard
| Challenge: | Sentiment analysis is a widely studied task in natural language processing. |
| Approach: | They propose to improve BERT-based models for sentiment analysis on italian corpora and evaluate their performance on the basis of eight corpors. |
| Outcome: | The proposed model is evaluated over eight sentiment analysis corpora from different domains and sources on the prediction of positive, negative and neutral classes. |
Copied to clipboard
| Challenge: | Sentiment analysis is one of the most widely studied applications in NLP, but most work focuses on languages with large amounts of data. |
| Approach: | They propose a large-scale human-annotated Twitter sentiment dataset for the four most widely spoken languages in Nigeria. |
| Outcome: | The proposed dataset includes 30,000 tweets and a significant fraction of code-mixed tweets. |
Copied to clipboard
| Challenge: | Using pragmatic theories of implicature, interpreting texts with implicit meaning correctly is essential for precise natural language understanding. |
| Approach: | They propose to use transformer models fine-tuned for sentiment analysis to illustrate the challenges in computational interpretation of implicatures. |
| Outcome: | The proposed model classifications reveal the limitations of supervised machine learning methods in detecting implicit sentiments. |
Copied to clipboard
| Challenge: | Contextualized word embeddings are available for many languages, but their coverage is limited for low resourced languages. |
| Approach: | They propose a method that integrates multilingual graph knowledge into the embeddings to make them green. |
| Outcome: | The proposed method outperforms state-of-the-art embeddings on lexical similarity task while being parameter-free at inference time. |
Copied to clipboard
| Challenge: | Existing domain adaptation methods for sentiment analysis are sensitive to domain differences, resulting in classifiers that perform poorly on new domains. |
| Approach: | They propose a domain adaptation problem as an embedding projection task using two mono-domain embeddable spaces and a bi-domain space to project across domains and predict sentiment. |
| Outcome: | The proposed model performs better on domains similar to state-of-the-art methods while requiring longer training times. |
Copied to clipboard
| Challenge: | Existing methods for attribution of importance to features borrowed from cooperative game theory . success of Deep Neural Networks has led to their ability to learn from complex higher order interactions from raw features. |
| Approach: | They propose a method for attributing importance scores to groups of features . they propose axioms that any intuitive feature group attribution method should satisfy . |
| Outcome: | The proposed method captures the importance of features in a linguistic model using negations and conjunctions. |
Copied to clipboard
| Challenge: | a challenge for aspect term extraction is to extract phrase-level aspect terms . a constituency lattice structure is constructed using the span annotations of constituents of a sentence . |
| Approach: | They propose to incorporate the span annotations of constituents of a sentence to leverage syntactic information in neural network models. |
| Outcome: | The proposed model outperforms existing models on two benchmark datasets. |
Copied to clipboard
| Challenge: | Disagreement arises from subjective human opinion and can vary with one’s identity, beliefs, and social environment. |
| Approach: | They propose a human-centered framework for reproducible ML evaluation and AI alignment that takes disagreement into account when building human-centric AI systems. |
| Outcome: | The proposed framework is based on a human-centered and perspective-aware framework for reproducible ML evaluation and AI alignment. |
Copied to clipboard
| Challenge: | Prior work on multimodal content classification has not addressed these challenges. |
| Approach: | They propose to use two auxiliary tasks to fine-tune multimodal models to address hidden cross-modal semantics and weak image-text relationships when modeling text and images. |
| Outcome: | The proposed model improves by up to 2.6 F1 score across five diverse social media datasets. |
Copied to clipboard
| Challenge: | Social media platforms such as X (formerly Twitter), Facebook, and Reddit generate user-generated content. |
| Approach: | They propose a framework to assess privacy risks in social media by evaluating vulnerabilities across six dimensions: data collection, preprocessing, visibility, fairness, computational risk, and regulatory compliance. |
| Outcome: | The proposed framework assesses privacy risks across six dimensions . it achieves F1-scores of 0.58–0.84, but incurs 1% - 23% drop under fine-tuning . |
Copied to clipboard
| Challenge: | Complex machine learning models are often brittle, making different predictions for input instances that are extremely similar semantically. |
| Approach: | They propose to generalize semantically equivalent adversarial rules that induce adversaries on many instances to detect brittle models. |
| Outcome: | The proposed rules generate high-quality local adversaries for more instances than humans and induce four times as many mistakes as human experts. |
Copied to clipboard
| Challenge: | Existing literature on Bangla Sentiment Analysis (SA) has limited data and cross-domain adaptability. |
| Approach: | They present a large-scale dataset of Bangla book reviews with 158,065 samples . they employ a range of machine learning models to establish baselines including SVM, LSTM, and Bangla-BERT. |
| Outcome: | The proposed model improves performance over models that rely on manual features. |
Copied to clipboard
| Challenge: | Existing methods for detecting offensive content rely on labeled datasets, but few consider low-resource languages with relatively less data available for training. |
| Approach: | They propose to use Korean as a dataset for offensive language identification . they propose to perform abusive language detection and sentiment analysis to help identify offensive languages. |
| Outcome: | The proposed datasets improve the performance of offensive language identification in Korean, while the existing methods are limited. |
Copied to clipboard
| Challenge: | Aspect sentiment classification (ASC) is a fundamental task in sentiment analysis. |
| Approach: | They propose to use memory networks to deal with ASC using aspect and sentence terms and use them to classify the sentiment polarity. |
| Outcome: | The proposed techniques can be implemented in a variety of contexts and their effectiveness is evaluated. |
Copied to clipboard
| Challenge: | Lexicon based methods for sentiment analysis rely on high quality polarity lexicons. |
| Approach: | They evaluate SentProp framework for inducing domain-specific polarities from word embeddings and use it to enhance a general-purpose lexicon for use in the political domain. |
| Outcome: | The proposed framework performs worse than the original lexicon in an out-domain task, showing that the words added and the polarity shifts applied are domain-specific and do not translate well to an out domain setting. |
Copied to clipboard
| Challenge: | AfriBERTa shows that training transformer models from scratch on 1GB of data from many unrelated African languages outperforms massively multilingual models on downstream NLP tasks. |
| Approach: | They propose that training on smaller amounts of data but from related languages could match the performance of models trained on large, unrelated data. |
| Outcome: | The proposed model outperforms models trained on large, unrelated datasets on downstream NLP tasks. |
Copied to clipboard
| Challenge: | Understanding attitudes expressed in texts plays an important role in systems for detecting false information online, be it misinformation (unintentionally false) or disinformation (intentional false information). |
| Approach: | They examine the relationship between stance detection and mis- and disinformation detection online and examine the results of previous studies. |
| Outcome: | The proposed task is a component of fact-checking, rumour detection, and detecting previously fact- checked claims, and is compared with other related tasks such as argumentation mining and sentiment analysis. |
Copied to clipboard
| Challenge: | Abstractive summarization is a task that generates short and concise summaries of user generated reviews. |
| Approach: | They propose an interactive attention mechanism to learn the representations of context and aspect words within reviews, acted as an encoder. |
| Outcome: | The proposed model achieves impressive results compared to other strong competitors on a real-life dataset. |
Copied to clipboard
| Challenge: | Negation is a contextual phenomenon that needs to be addressed in sentiment analysis. |
| Approach: | They propose a supervised learning approach to disambiguate verbal shifters using generalization features and a new lexicon. |
| Outcome: | The proposed approach takes into account various features, particularly generalization features. |
Copied to clipboard
| Challenge: | In July 2019, RoBERTa was the first to surpass a human baseline on GLUE . since then, 13 more methods have outperformed humans on the GLu leaderboard . |
| Approach: | They found that 75% to 90% of correct predictions of BERT-based classifiers remain constant after input words are randomly shuffled. |
| Outcome: | The proposed model outperforms humans on GLUE and SQuAD 2.0. |
Copied to clipboard
| Challenge: | Sentiment Analysis of text is an important task in many applications . but the task becomes challenging when it comes to low resource languages . |
| Approach: | They propose to create a corpus of polarity-based sentiment classifiers in Telugu for different domains like movie reviews, song lyrics, product reviews and book reviews. |
| Outcome: | The proposed model performs well in multiple domains and is compared with the previous models. |
Copied to clipboard
| Challenge: | Existing approaches to learning invariant representations rely on the assumption that training and test sets come from the same domain. |
| Approach: | They propose to extend a classification model trained on multiple source domains to an unseen target domain by using key-value memory. |
| Outcome: | The proposed method improves on sentiment analysis and natural language inference tasks. |
Copied to clipboard
| Challenge: | In implicit sentiment analysis, the opinion cues come in an implicit and obscure manner. |
| Approach: | They propose a three-step prompting principle for THOR to step-by-step induce the implicit aspect, opinion and finally the sentiment polarity. |
| Outcome: | The proposed framework pushes the state-of-the-art (SoTA) by over 6% F1 on supervised setup and more strikingly, boosts the SoTA by over 50% F1 with THOR+GPT3. |
Copied to clipboard
| Challenge: | Embedding words in vector space is a fundamental first step in state-of-the-art natural language processing. |
| Approach: | They propose to embed words in vector space using propositional logic instead of dense vectors . they evaluate embeddings on intrinsic and extrinsic benchmarks and visualize word clusters based on their results . |
| Outcome: | The proposed model outperforms GLoVe on six classification tasks. |
Copied to clipboard
| Challenge: | sentiment analysis research has focused on unsupervised or semi-supervised approaches, but these still require a large number of resources and do not reach the performance of supervised approaches. |
| Approach: | They propose two datasets for supervised aspect-level sentiment analysis in Basque and Catalan. |
| Outcome: | The proposed datasets are based on two under-resourced languages, basque and catalan. |
Copied to clipboard
| Challenge: | Existing methods for identifying suicidal ideation in phone conversations are difficult to use because of their long duration and noisy nature. |
| Approach: | They propose a self-adaptive approach that identifies the most critical utterances that the NLP model can more easily distinguish. |
| Outcome: | The proposed approach outperforms the baseline models in overall performance with an F score of 66.01% and significantly higher F-score in detecting the most dangerous cases. |
Copied to clipboard
| Challenge: | Transfer learning methods have shown that reusing non-task-specific knowledge can speed up task-specific learning in the latter. |
| Approach: | They propose to port whole functional modules that encode task-specific knowledge from one model to another using parameter-efficient finetuning techniques. |
| Outcome: | The proposed methods outperform the two alternatives, but there are differences between the two. |
Copied to clipboard
| Challenge: | Emojis are textual elements that are encoded as characters but rendered as small digital images or icons that can be used to express an idea or emotion. |
| Approach: | They propose to use a set of popular NLP tools to assess the support of emojis in tweets. |
| Outcome: | The proposed methods show that many systems still have notable shortcomings when operating on text containing emojis. |
Copied to clipboard
| Challenge: | State-of-the-art NLP models require hundreds of millions and even billions of parameters to perform, which can lead to memory usage and increased runtime. |
| Approach: | They propose a structure learning method that uses group lasso to learn sparse, parameter-efficient NLP models by pruning more than 90% of the weights of rational RNNs. |
| Outcome: | The proposed method learns sparse, parameter-efficient models without sacrificing performance relative to parameter-rich baselines. |
Copied to clipboard
| Challenge: | Existing solutions to zero-shot text classification use pre-trained language models or large-scale annotated data. |
| Approach: | They propose a self-supervised learning paradigm to solve zero-shot text classification tasks by tuning the language models with unlabeled data. |
| Outcome: | The proposed model outperforms the state-of-the-art models on 7 out of 10 tasks and is less sensitive to prompt design. |
Copied to clipboard
| Challenge: | Social media sites have the potential to complement surveys that measure political opinions and, more specifically, political actors’ approval. |
| Approach: | They propose to compare untargeted sentiment, targeted sentiment, and stance detection methods to a set of custom models trained on minimal custom data. |
| Outcome: | The proposed methods have low generalizability on unseen and familiar targets, while low-resource custom models are more robust. |
Copied to clipboard
| Challenge: | The Latvian Twitter Eater Corpus (LTEC) is a collection of tweets gathered by following the appearance of 363 keywords related to food, drinks, eating and drinking in various valid word forms in the Latvian language. |
| Approach: | They build upon the Latvian Twitter Eater Corpus which is focused on the narrow domain of tweets related to food, drinks, eating and drinking. |
| Outcome: | The Latvian Twitter Eater Corpus (LTEC) is a collection of tweets gathered by following the appearance of 363 keywords related to food and eating inflected in various valid word forms in the Latvian language. |
Copied to clipboard
| Challenge: | Large Language Models have been used for sentiment analysis, machine translation, and question answering, but their effectiveness in the multilingual financial domain remains unknown. |
| Approach: | They propose a fine-tuning approach that integrates positive and negative rationales alongside classification labels. |
| Outcome: | The proposed approach outperforms existing methods across English, Hindi, Bengali, and Telugu, and is suitable for industry applications. |
Copied to clipboard
| Challenge: | Masked language modeling is widely adopted, but the process of selecting tokens for masking is random and the percentage of masked tokens is typically fixed for the entire training process. |
| Approach: | They propose to adjust the masking ratio based on a task-informed anti-curriculum learning scheme to mask useful and harmful tokens. |
| Outcome: | The proposed approach improves the ability of the model to focus on key task-relevant features, contributing to statistically significant performance gains across tasks. |
Copied to clipboard
| Challenge: | Quantum-inspired models have demonstrated superior performance in many downstream language tasks, such as question answering and sentiment analysis. |
| Approach: | They propose a quantum-inspired neural network that integrates the Lindblad Master Equation to model the evolution process and the interferometry to the measurement process, providing more physical meaning to strengthen the interpretability. |
| Outcome: | The proposed model outperforms existing models on sentiment analysis datasets and shows that it is more accurate and performs better than existing models. |
Copied to clipboard
| Challenge: | Recent studies show that self-attention based models have limitations on modeling sequential transformations. |
| Approach: | They propose to extract some explainable features from trained RNNs that are reminiscent of classical n-grams features. |
| Outcome: | The proposed models can model interesting linguistic phenomena such as negation and intensification. |
Copied to clipboard
| Challenge: | Prompt engineering is an essential technique for enhancing the abilities of large language models (LLMs) by providing explicit and specific instructions. |
| Approach: | They propose a new approach that uses text embeddings to obtain basis vectors by matrix decomposition and constructs a space for representing all prompts. |
| Outcome: | The proposed approach significantly outperforms state-of-the-art prompt paradigms on ten public reasoning benchmarks. |
Copied to clipboard
| Challenge: | Existing methods to optimize tokenizations for downstream tasks are not suitable for traditional NLP. |
| Approach: | They propose a method to explore a tokenization appropriate for a downstream task . they train a model to assign a high probability to such appropriate tokenization based on the downstream task loss . |
| Outcome: | The proposed method improves sentiment analysis and textual entailment tasks . it is also integrated into state-of-the-art contextualized embeddings and reports a positive effect . |
Copied to clipboard
| Challenge: | Existing sentiment analysis tasks focus on text comprehension, but visual content is important for emotional expression. |
| Approach: | They propose a multimodal framework that integrates information from various modalities for sentiment classification of fashion posts. |
| Outcome: | The proposed framework outperforms existing unimodal and multimodal baselines on a comprehensive dataset and significantly outperformed existing unilmodal and multiple modal frameworks. |
Copied to clipboard
| Challenge: | Existing studies focus on English-centric aspects of sentiment analysis, limiting scope for multilingual evaluation and research. |
| Approach: | They propose to use a multilingual dataset to analyze aspects with associated sentiment elements in text. |
| Outcome: | The proposed dataset is the most extensive multilingual parallel dataset for ABSA to date. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable capabilities in comprehending and analyzing lengthy sequential inputs. |
| Approach: | They propose to implement ad-hoc solutions that enhance LLMs’ performance on long input sequences by up to 50% while reducing API cost and latency by up . to address this limitation, they propose to use three datasets and two tasks to analyze news categorization and sentence analysis to evaluate their models. |
| Outcome: | The proposed solutions significantly improve LLMs’ performance on long input sequences by up to 50% while reducing API cost and latency by up . to 93% and 50%, respectively. |
Copied to clipboard
| Challenge: | Adapting a model to a handful of personalized data is challenging, authors say . standard fine-tuning requires hundreds of millions of parameters for each user . |
| Approach: | They propose a lightweight method that clamps millions of parameters of a Transformer model and optimizes a tiny user-specific vector. |
| Outcome: | The proposed method improves accuracy on Yelp and IMDB datasets and reduces the number of parameters added for each user. |
Copied to clipboard
| Challenge: | Existing models lack feature representations that capture the deep semantics of language and sensitivity to minor input variations, resulting in significant changes in the generated text. |
| Approach: | They propose an end-to-end model architecture called ASEM that performs emotion analysis on top of sentiment analysis for open-domain chatbots. |
| Outcome: | The proposed model outperforms existing models for generating empathetic embeddings, providing e-mpathetic and diverse responses. |
Copied to clipboard
| Challenge: | Recent multimodal learning models with strong performances on human-centric tasks are often black-box with very limited interpretability. |
| Approach: | They propose a multimodal routing algorithm which dynamically adjusts weights between input and output modalities for each input sample. |
| Outcome: | The proposed model can interpret modality-prediction relationships globally and locally for each input sample while keeping competitive performance compared to state-of-the-art methods. |
Copied to clipboard
| Challenge: | Appraisal framework in linguistics defines the framework for fine-grained evaluations and opinions. |
| Approach: | They propose to use language models to automatically identify and annotate text segments for appraisal. |
| Outcome: | The proposed model achieves superior performance than baseline adapter-based models and other neural classification models for cross-domain and cross-language settings. |
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis (ABSA) is a fine-grained task in sentiment analysis. |
| Approach: | They compare a model with a dependency parser and a tree from a fine-tuned RoBERTa model to find the polarities for aspects in a sentence. |
| Outcome: | The proposed model outperforms the parser-provided tree on six datasets across four languages. |
Copied to clipboard
| Challenge: | Experimental results show that self-attentive neural models are more robust against adversarial perturbations compared to recurrent neural networks. |
| Approach: | They propose an adversarial attack algorithm that generates more natural adversarials . they propose to use the attention mechanism to learn a context-dependent representation . |
| Outcome: | The proposed attack algorithm generates more natural adversarial examples that could mislead models but not humans. |
Copied to clipboard
| Challenge: | Modern NLP systems are typically ill-equipped when applied to noisy user-generated text. |
| Approach: | They propose a new evaluation framework consisting of seven Twitter-specific classification tasks. |
| Outcome: | The proposed framework is based on seven heterogeneous Twitter-specific classification tasks. |
Copied to clipboard
| Challenge: | Existing methods to regularize multimodal data are imperfect due to imperfect modalities, missing entries or noise corruption. |
| Approach: | They propose a method to regularize multimodal data by tensor rank minimization . they use correlations between time and modalities to generate low-rank tenses . |
| Outcome: | The proposed model achieves good results across various levels of imperfection. |
Copied to clipboard
| Challenge: | Existing methods for encoding text into lossless representations focus on performing well on downstream tasks and are unable to reconstruct original sequence from learned embedding. |
| Approach: | They propose a lossless method for encoding long sequences of texts into feature rich representations by recursive autoencoding. |
| Outcome: | The proposed method performs well on sentiment analysis and sentiment classification tasks. |
Copied to clipboard
| Challenge: | Recent studies reveal a security threat to natural language processing models, called the Backdoor Attack. |
| Approach: | They propose to hack a model by modifying one single word embedding vector without sacrificing accuracy on clean samples. |
| Outcome: | The proposed method is more efficient and stealthier on sentiment analysis and sentence-pair classification tasks. |
Copied to clipboard
| Challenge: | Recent studies on sentiment analysis of memes have focused on English, but there is a significant barrier to performing multimodal sentiment analysis research in resource-constrained languages like Bengali. |
| Approach: | They propose to use a Bengali dataset to perform multimodal sentiment analysis in low resource languages. |
| Outcome: | The proposed dataset for Bengali contains 4417 memes with three annotated labels positive, negative, and neutral. |
Copied to clipboard
| Challenge: | Sentiment analysis is a key task in e-commerce to detect fine-to-coarse sentiment polarities. |
| Approach: | They propose to use a large-scale Chinese restaurant review dataset ASAP to investigate the sentiment polarities underlying user reviews. |
| Outcome: | The proposed model outperforms state-of-the-art models on both tasks. |
Copied to clipboard
| Challenge: | Fig. 1 shows how style-transferred multi-modal features can be used in sentiment analysis and emotion recognition. |
| Approach: | They propose to use adaptive normalization to impose style onto text to learn richer representations for multi-modal utterances. |
| Outcome: | The proposed model achieves performance on par with state-of-the-art but using less than a third of the model parameters. |
Copied to clipboard
| Challenge: | Existing methods for document classification in social networks capture only semantics of texts . incorporating social network information in addition to textual information is effective . |
| Approach: | They propose to incorporate social network information into document classification tasks . they use email as a feature and model email thread structure . |
| Outcome: | The proposed method improves over a state-of-the-art baseline based on textual information . the proposed method is based in two corpora, one of which we train on . |
Copied to clipboard
| Challenge: | Existing word embeddings use different bilingual supervision signals with varying levels of strength. |
| Approach: | They propose a graph modularity metric to measure word embedding quality . they use a set of 500 words belonging to 59 neurobiologically motivated semantic categories . |
| Outcome: | The proposed metric measures word embedding quality on monolingual and cross-lingual tasks. |
Copied to clipboard
| Challenge: | Existing prompt tuning methods for cross-domain sentiment analysis have been underutilized due to domain discrepancy in the token distributions. |
| Approach: | They propose a new method to model cross-domain sentiment analysis using pre-trained language models by using soft prompts instead of hard templates. |
| Outcome: | The proposed method achieves state-of-the-art results on a publicly available sentiment analysis dataset. |
Copied to clipboard
| Challenge: | Pre-trained language models are vulnerable to simple perturbations, causing poor robustness . recent studies show that adversarial training is useless or harmful for the model to detect these semantic changes. |
| Approach: | They propose to use adversarial training to improve the robustness of pre-trained models . they propose to construct negative examples with similar and opposite semantics . |
| Outcome: | Empirical results show that the proposed approach improves on sentiment analysis, reasoning, and reading comprehension tasks. |
Copied to clipboard
| Challenge: | Recent work has focused on the performance of Large Language Models (LLMs) but the finance sector is relying on time-series data for complex forecasting tasks. |
| Approach: | They propose a framework that employs Sequential Knowledge-Guided Prompting to identify factors that influence stock movements using LLMs. |
| Outcome: | The proposed framework outperforms existing methods and is effective in time-series forecasting. |
Copied to clipboard
| Challenge: | Sentiment analysis is an early success story for NLP, in both a technical and an industrial sense. |
| Approach: | They propose to combine naturally occurring sentences with sentences created using the open-source Dynabench Platform, which facilities human-and-model-in-the-loop dataset creation. |
| Outcome: | The proposed model is more coherent than comparable models and motivates training models from scratch over successive fine-tuning. |
Copied to clipboard
| Challenge: | Affective word distributions are not well understood in literature. |
| Approach: | They propose a model that embeds affective word interpretations into enriched word embeddings. |
| Outcome: | The proposed model outperforms the state-of-the-art in word-similarity tasks and in emotion analysis, personality detection, and frustration prediction tasks. |
Copied to clipboard
| Challenge: | Existing methods to model multimodal sentiment analysis are limited due to their complexity and memory footprint. |
| Approach: | They propose a multimodal Sparse Phased Transformer to reduce self-attention complexity and memory footprint. |
| Outcome: | The proposed method achieves comparable or superior performance with a 90% reduction in the number of parameters. |
Copied to clipboard
| Challenge: | Existing approaches to learn domains with massive data are not easy to implement and require a predefined threshold. |
| Approach: | They propose a framework that searches for training instances relevant to the target domain and learns better representations for them. |
| Outcome: | The proposed framework is effective in data selection and representation, but generalized to accommodate different NLP tasks. |
Copied to clipboard
| Challenge: | Existing sentiment analyzers for MRLs that use tokens and morpheme-based representations have no empirically studied effects of representation choices on neural sentiment analysis. |
| Approach: | They develop a sentiment analysis benchmark for Hebrew based on 12K social media comments and provide two instances of data. |
| Outcome: | The proposed benchmarks show that representation choices have measurable effects on task perfromance and that they vary depending on architecture type. |
Copied to clipboard
| Challenge: | Humblebragging is a phenomenon in which individuals present self-promotional statements under the guise of modesty or complaints. |
| Approach: | They propose a task of automatically detecting humblebragging in text and propose '4-tuple definition' they also propose machine learning, deep learning, and large language models to perform the task . |
| Outcome: | The proposed model achieves an F1-score of 0.88 and is non-trivial even for humans. |
Copied to clipboard
| Challenge: | a new type of deep contextualized word representation is proposed for language understanding problems . word vectors are learned functions of the internal states of a deep bidirectional language model . |
| Approach: | They propose a new type of deep contextualized word representation that models complex features of word use and how they vary across linguistic contexts. |
| Outcome: | The proposed representations improve the state of the art across six challenging NLP problems. |
Copied to clipboard
| Challenge: | Existing benchmarks for large language models fail to detect bias due to limited scope, contamination, and lack of a fairness baseline. |
| Approach: | They propose a benchmarking pipeline to detect biases in large language models . they use metrics for max disparity, impact ratio, and bias concentration to analyze disparity . |
| Outcome: | SAGED(bias) is the first holistic benchmarking pipeline to address biases in large language models. |
Copied to clipboard
| Challenge: | a large amount of work on cross-lingual transfer learning focused on typological and genealogical similarities between languages. |
| Approach: | They propose three features that capture cross-cultural similarities that manifest in linguistic patterns and quantify distinct aspects of language pragmatics. |
| Outcome: | The proposed features capture cross-cultural similarities manifest in linguistic patterns and quantify aspects of language pragmatics. |
Copied to clipboard
| Challenge: | Existing literature on Arabic sentiment analysis is limited, compared to high-resourced languages such as English and French. |
| Approach: | They present a systematic review of existing literature on Arabic sentiment analysis focusing on research utilizing deep learning. |
| Outcome: | The proposed methods highlight gaps in the literature on Arabic sentiment analysis and outline promising directions for future research. |
Copied to clipboard
| Challenge: | Convolutional neural networks (CNNs) are a popular building block for natural language processing . despite their success, most existing CNN models share the same learned set of filters for all input sentences. |
| Approach: | They propose to use a meta network to learn context-sensitive convolutional filters for text processing by using a bidirectional filter generation mechanism. |
| Outcome: | The proposed framework outperforms standard and attention-based CNN models on four different tasks. |
Copied to clipboard
| Challenge: | Ordinal Classification (OC) tasks require ordinal classes, not nominal ones, to be evaluated. |
| Approach: | They use data from the SemEval and NTCIR communities to clarify evaluation measures for Ordinal Classification and Ordinal Quantification tasks. |
| Outcome: | The evaluation measures for Ordinal Classification (OC) and Ordinal Quantification (OQ) tasks are ordinal, not nominal. |
Copied to clipboard
| Challenge: | Recent Transformer-based contextual word representations have shown state-of-the-art performance in multiple disciplines within NLP. |
| Approach: | They propose an attachment to BERT and XLNet that allows them to accept multimodal nonverbal data during fine-tuning. |
| Outcome: | The proposed attachment allows BERT and XLNet to accept multimodal nonverbal data during fine-tuning. |
Copied to clipboard
| Challenge: | Existing methods for document classification do not consider document filtering . existing methods do not include document filter. |
| Approach: | They propose a deep relevance model for zero-shot document filtering called DAZER . they use word embeddings to extract the relevance signals from word embeds . |
| Outcome: | The proposed model outperforms existing models on two document collections . it estimates the relevance between a document and a category by using seed words . |
Copied to clipboard
| Challenge: | Tweets are short messages that often include specialized language such as hashtags and emojis. |
| Approach: | They propose a simple strategy to replace emojis with their natural language description and use pretrained word embeddings to process tweets. |
| Outcome: | The proposed method is more effective than pretrained emoji embeddings for tweet classification. |
Copied to clipboard
| Challenge: | Modern machine learning works with massive amounts of data on a range of tasks like language modeling, object detection, and data mining. |
| Approach: | They propose a probabilistic robustness rewarded data optimization approach to enhance the model's generalization power by selecting training data that optimizes probabilistic metrics. |
| Outcome: | The proposed approach achieves +17.2% increase of accuracy and -28.05 decrease of perplexity on unknown-domain test sets. |
Copied to clipboard
| Challenge: | Masked language modeling (MLM) is often dominated by high-frequency words that are sub-optimal for learning factual knowledge. |
| Approach: | They propose an approach that forces the model to prioritize informative words in a fully unsupervised way. |
| Outcome: | The proposed approach significantly improves the performance of pretrained language models on factual recall, question answering, sentiment analysis, and natural language inference in a closed-book setting. |
Copied to clipboard
| Challenge: | Existing studies have attempted to personalize models to improve performance on NLP tasks such as sentiment analysis but they did not estimate subjective input. |
| Approach: | They propose a method of modeling personal biases in word meanings with personalized word embeddings by solving a task on subjective text while regarding words used by different individuals as different words. |
| Outcome: | The proposed method improves sentiment analysis and target task with reviews retrieved from RateBeer. |
Copied to clipboard
| Challenge: | a recent study has established sentiment analysis as an alluring problem, but many feelings are left unexplored. |
| Approach: | They propose a framework to learn the polarity of emotions from Twitter posts . they compare optimism detection with sentiment analysis and hate speech detection . |
| Outcome: | The proposed framework differs between optimistic and pessimistic users on the Optimism/Pessimism Twitter dataset. |
Copied to clipboard
| Challenge: | a novel retrofitting method to induce emotion aspects into pre-trained language models is proposed . the models are computationally less expensive and open, but do not capture affective aspects of human communication well. |
| Approach: | They propose a retrofitting method to induce emotion aspects into pre-trained language models . they retrofit text fragments exhibiting similar emotions into pretrained networks . |
| Outcome: | The proposed method produces emotion-aware text representations for sentiment analysis and sarcasm detection tasks. |
Copied to clipboard
| Challenge: | Recent trends in NLP research have raised an interest in linguistic code-switching . however, many of these approaches are limited to a few language pairs and a specific domain . |
| Approach: | They propose a centralized benchmark for Linguistic Code-switching Evaluation that combines eleven corpora covering four different code-switch languages and four tasks. |
| Outcome: | The proposed benchmark provides a centralized benchmark and compares with other benchmarks in real-time. |
Copied to clipboard
| Challenge: | Existing research on word vectors for English focuses on decomposing words into subword units and using subwords to improve performance. |
| Approach: | They propose to decompose Korean words into the jamo-level, beyond the character-level . they develop Korean test sets for word similarity and analogy and make them publicly available . |
| Outcome: | The proposed method outperforms word2vec and character-level skip-grams on similarity and analogy tasks and contributes positively toward downstream NLP tasks such as sentiment analysis. |
Copied to clipboard
| Challenge: | Existing data pruning methods for active learning are expensive and time-consuming. |
| Approach: | They propose a plug-and-play data pruning strategy that leverages language models to prune the unlabeled pool. |
| Outcome: | The proposed pruning strategy outperforms existing pruning methods on translation, sentiment analysis, topic classification, and summarization tasks on diverse datasets. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have achieved promising results in sentiment analysis through the in-context learning paradigm. |
| Approach: | They propose a framework that incorporates prior predictions and feedback to improve sentiment understanding by incorporating prior feedback and leveraging a feedback-driven prompt. |
| Outcome: | The proposed framework improves on nine sentiment analysis datasets with an average improvement of 5.95% over conventional methods. |
Copied to clipboard
| Challenge: | Existing methods for sentiment classification focus on learning domain-invariant representations . few of them pay attention to domain-specific information, which should also be informative. |
| Approach: | They propose a method to extract domain specific and invariant representations and train a classifier on each of them. |
| Outcome: | The proposed model can achieve better performance than state-of-the-art methods. |
Copied to clipboard
| Challenge: | Hashtags are used to add metadata to textual utterances, but their semantic content is difficult to infer as they often contain multiple tokens joined together. |
| Approach: | They propose to use a dataset of 12,594 hashtags to infer hashtag semantics . they propose to frame the problem as a pairwise ranking problem between candidate segmentations . |
| Outcome: | The proposed methods show 24.6% error reduction in hashtag segmentation accuracy compared to the current state-of-the-art method. |
Copied to clipboard
| Challenge: | Many text classification algorithms depend on the size of the corpus’ vocabulary due to their bag-of-words representation. |
| Approach: | They propose to evaluate how preprocessing techniques affect the run-time of models by evaluating ten techniques over four models and two datasets. |
| Outcome: | The proposed methods can reduce run-time with no loss of accuracy while sacrificing up to 65%. |
Copied to clipboard
| Challenge: | morphological typology has been used to improve cross-lingual transfer . however, some language families and typologies consistently perform worse . |
| Approach: | They examine effects of morphological typology on zero-shot cross-lingual transfer . they perform part-of-speech tagging and sentiment analysis on 19 languages . |
| Outcome: | The proposed model improves on fusional and introflexive languages, but some language families and typologies perform worse. |
Copied to clipboard
| Challenge: | a framework for gathering entity-centered information is needed in real-life scenarios . a social web observatory system allows users to define their own entities . |
| Approach: | They propose a framework for the collection and summarization of information from the Web in an entity-driven manner. |
| Outcome: | The proposed framework is based on a language analysis pipeline and a human user study. |
Copied to clipboard
| Challenge: | Existing methods for uncertainty estimation are inadequate for safety-critical applications. |
| Approach: | They propose a method that uses the distances from neighbors and the ratio of labels in neighbors to estimate uncertainty. |
| Outcome: | The proposed method outperforms baseline and density-based methods in calibration and uncertainty metrics. |
Copied to clipboard
| Challenge: | Existing studies focus on improving the performance of domain-specific models based on the target dataset. |
| Approach: | They propose a Large Language Model-based Continual Learning (LLM-CL) model for ABSA that learns the target domain’s ability while maintaining the history domains’ abilities. |
| Outcome: | The proposed model obtains new state-of-the-art over 19 datasets. |
Copied to clipboard
| Challenge: | Currently, global models are not able to produce personalized responses for individual users, based on their data. |
| Approach: | They propose a scheme for training a single shared model for all users by prepending a fixed, user-specific non-trainable string to each user’s input text. |
| Outcome: | The proposed method outperforms the state-of-the-art model on a suite of sentiment analysis datasets by up to 13 points. |
Copied to clipboard
| Challenge: | Existing methods to interpret NLP predictions replace each token with a predefined value, resulting in misleading interpretations. |
| Approach: | They propose to marginalize each token out of the training data distribution to demystify the "black box" property of deep neural networks for natural language processing. |
| Outcome: | The proposed method marginalizes each token out of the training data distribution. |
Copied to clipboard
| Challenge: | Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. |
| Approach: | They propose to provide a measure of robustness against word substitutions by computing a safe radius for a given input text. |
| Outcome: | The proposed methods are compared with LIME and CNN-Cert and show that they perform well on sentiment analysis and news classification models. |
Copied to clipboard
| Challenge: | Existing studies show that not all languages positively influence each other . multilingual training can help in those cases by sharing knowledge across languages . |
| Approach: | They propose a gradient similarity-based language grouping method for multilingual training that is better correlated with cross-lingual model performance. |
| Outcome: | The proposed method leads to the largest performance gains on a multilingual dataset and is better correlated with cross-lingual model performance. |
Copied to clipboard
| Challenge: | Euphemisms are a difficult topic because they are subject to language change and humans may not agree on what is a euphemist. |
| Approach: | They analyze a corpus of potentially euphemistic terms (PETs) and examples from the GloWbE corpus to examine their meanings. |
| Outcome: | The proposed corpus of potentially euphemistic terms and examples from the GloWbE corpus show that PETs generally decrease negative and offensive sentiment. |
Copied to clipboard
| Challenge: | Existing methods for sentiment analysis require human annotations, but they are scarce. |
| Approach: | They propose a posterior regularization framework to control the posterior distribution of label assignment. |
| Outcome: | The proposed framework improves the variational approach to the weakly supervised sentiment analysis and the performance is more stable with smaller prediction variance. |
Copied to clipboard
| Challenge: | Existing studies integrate word embeddings with cognitive features into neural models of natural language processing (NLP) but there are some issues in the use of cognitive features in NLP. |
| Approach: | They propose a cog-align approach that aligns textual and cognitive inputs to capture differences and commonalities. |
| Outcome: | The proposed model improves on three NLP tasks with multiple cognitive features over state-of-the-art models. |
Copied to clipboard
| Challenge: | We compare attention functions in pre-trained language models to human eye fixation patterns during task-specific reading tasks. |
| Approach: | They compare attention functions in large-scale pre-trained language models to classical cognitive models of human attention by using a dataset with eye-tracking recordings of native speakers of English. |
| Outcome: | The proposed model is as predictive of human eye fixation patterns as classical cognitive models of human attention. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have become central to NLP, demonstrating their ability to adapt to various tasks through prompting techniques. |
| Approach: | They probe the hidden layers of Large Language Models to identify where sentiment features are most represented and to assess how this affects sentiment analysis. |
| Outcome: | The proposed approach enables sentiment tasks to be performed with memory requirements reduced by an average of 57%. |
Copied to clipboard
| Challenge: | Existing datasets for emotion detection are heterogeneous in size, domain, format, splits, emotion categories and role labels, hampering progress in this area. |
| Approach: | They propose a framework for annotating emotions manually using a common labeling scheme to unify several datasets tagged with emotions and semantic roles. |
| Outcome: | The proposed framework unifies datasets tagged with emotions and semantic roles by using a common labeling scheme. |
Copied to clipboard
| Challenge: | English and Chinese have seen the strong development of transformer-based language models for natural language processing tasks. |
| Approach: | They present a monolingual pre-trained language model for Vietnamese social media texts . they explore emotion recognition, hate speech detection, sentiment analysis, spam reviews detection . |
| Outcome: | The proposed model outperforms the existing models on Vietnamese social media tasks with fewer parameters. |
Copied to clipboard
| Challenge: | Existing studies on sentiment lexicons have focused on domain-dependent sentiment words. |
| Approach: | They propose a graph-based technique to detect and correct domain-dependent sentiment words . they propose to use a sentiment lexicon to classify sentiments in a lexical-based classifier . |
| Outcome: | The proposed method is effective on multiple datasets from different domains. |
Copied to clipboard
| Challenge: | Ordinal classification (OC) is a key task in natural language processing with applications in various domains such as sentiment analysis, rating prediction, and more. |
| Approach: | They propose to tackle ordinal classification (OC) through the implicit semantics of the labels . they propose to use a classical explicit approach and an implicit approach that organically engages the semantics. |
| Outcome: | The proposed methods are based on pre-trained language models and offer strategic recommendations based upon specific settings. |
Copied to clipboard
| Challenge: | Existing methods for ACSA fail to model relations of target words and opinion words in a sentence including multiple aspects. |
| Approach: | They propose to incorporate AMR into a text generation model to model relations of target words and opinion words in a sentence including multiple aspects. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three datasets. |
Copied to clipboard
| Challenge: | affixoids are morphemes in between affids and free stems that have been associated with increased productivity and a bleached semantics but not empirically validated. |
| Approach: | They propose to use affixoids as morphemes in between affids and stems to test their classification in a subset of German words that includes many hapaxes. |
| Outcome: | The proposed morpheme can be classed as affixoid or non-affixoids with a best F1 score of 74% on a subset of German words that includes many hapaxes . |
Copied to clipboard
| Challenge: | Existing approaches to enhance aspect-level sentiment analysis have omitted syntactic information . experimental results show that our approach outperforms baseline models on all datasets . |
| Approach: | They propose to leverage word dependencies to enhance aspect-level sentiment analysis . they propose to use key-value memory networks to leverage different dependency results . |
| Outcome: | The proposed approach outperforms baseline models on all datasets and achieves state-of-the-art performance on three of them. |
Copied to clipboard
| Challenge: | Many studies on sentiment analysis focus on the fact that sentiment computations are compositional . linguistic utterances often do not adhere to strict patterns and can be surprising when looking at the individual words involved. |
| Approach: | They propose a method for obtaining non-compositionality ratings for phrases with respect to their sentiment . they also propose evaluating computational models for sentiment analysis using the rating resource . |
| Outcome: | The proposed method enables non-compositional ratings for phrases with respect to their sentiment . the results are compared with a new resource of ratings for 259 phrases . |
Copied to clipboard
| Challenge: | Existing methods to evaluate NLP models are limited to news domains and cannot be generalized to other domains. |
| Approach: | They propose a measure of NLP quality based on robustness . they measure consistency of cross-domain accuracy and introduce coefficient of variation and gamma-Robustness based upon human evaluation . |
| Outcome: | The proposed approach shows higher agreement with human evaluation than accuracy scores on ranking machine translation systems. |
Copied to clipboard
| Challenge: | Existing deep neural network models such as LSTM and tree-LSTM have a bias problem where the words in the tail of a sentence are more heavily emphasized than those in the header. |
| Approach: | They propose a capsule tree-LSTM model that uses dynamic routing to build sentence representations by assigning different weights to nodes according to their contributions to prediction. |
| Outcome: | The proposed model improves on the Stanford Sentiment Treebank and EmoBank datasets. |
Copied to clipboard
| Challenge: | Existing methods for emotion extraction and sentiment analysis produce invalid results due to the use of irony. |
| Approach: | They propose to use emoji prediction to fine tune a model using hand labeled tweets with irony tags. |
| Outcome: | The proposed method outperforms the state-of-the-art method on Persian dataset with an accuracy of 83.1% and offers strong baseline for further research in Persian language. |
Copied to clipboard
| Challenge: | Semi-supervised learning (SSL) is a promising technique for improving deep learning models when training data is scarce. |
| Approach: | They propose a semi-supervised learning approach that leverages training dynamics of unlabeled data. |
| Outcome: | The proposed method achieves an average increase in F1 score of 3.5% over baselines in low resource settings. |
Copied to clipboard
| Challenge: | Fine-grained classification tasks involve distinguishing between classes with subtle differences between them. |
| Approach: | They analyse fine-grained text classification tasks by embedding class relationships into a contrastive objective function to help differently weigh the positives and negatives. |
| Outcome: | The proposed model outperforms previous contrastive methods on emotion classification and sentiment analysis. |
Copied to clipboard
| Challenge: | Existing methods for data augmentation address data deficiencies and semantic consistency, but they ignore the second issue. |
| Approach: | They propose a semantics-preserving data augmentation approach that preserves the semantics of a textual sequence. |
| Outcome: | The proposed method achieves better performance on publicly available datasets and stock price/risk movement prediction scenarios. |
Copied to clipboard
| Challenge: | Word embeddings that encode lexical-semantic relations do not capture emotion aspects of words. |
| Approach: | They propose a retrofitting method to update the vectors of emotion bearing words . they find that the retrofitted embeddings achieve better distances between clusters . |
| Outcome: | The proposed method achieves better distances between clusters and clusters for words having the same emotions. |
Copied to clipboard
| Challenge: | Existing Ordinal Classification metrics ignore the ordering between items or assume additional information. |
| Approach: | They propose a Closeness Evaluation Measure for Ordinal Classification based on Measurement Theory and Information Theory. |
| Outcome: | The proposed metric captures quality aspects from different traditional tasks simultaneously. |
Copied to clipboard
| Challenge: | Existing methods for word embeddings are limited by the definition of 'low' dimensionality, which is often used to train word embeds into low dimensional continuous vector space. |
| Approach: | They propose a method to select the number of dimensions for word embeddings using PCA. |
| Outcome: | The proposed method trains one embedding with a generous upper bound (e.g. 1,000) of dimensions and then removes the lesser dimensions one at a time while recording the embeddables’ performance on language tasks. |
Copied to clipboard
| Challenge: | Recent methods that learn robust prototypes to represent aspects with limited support samples address noise categories in the support set that hinder their models from effective prototype generation. |
| Approach: | They propose a causal denoising prototypical network for few-shot MACD by learning robust prototypes to represent categories with limited support samples. |
| Outcome: | The proposed model outperforms baseline models and can prevent models from overly predicting more categories and mitigate semantic ambiguity issues among categories. |
Copied to clipboard
| Challenge: | Pre-trained Language Models (PLMs) exhibit good accuracy and generalization ability but their large size results in high inference latency. |
| Approach: | They propose an unsupervised domain adaptation framework that employs knowledge distillation to achieve domain-invariant representations at each layer. |
| Outcome: | The proposed framework outperforms early exit methods and domain adaptation methods under domain shift scenarios. |
Copied to clipboard
| Challenge: | Using sentiment annotations, we find no corpus for written Swiss German, which is considered low-resourced due to its non-official status and phonetic differences. |
| Approach: | They propose to annotate a Swiss German corpus with sentiment annotations for sentiment analysis using Facebook comments and online chats. |
| Outcome: | The proposed corpus consists of more than 200,000 phrases and 1843 phrases with labels positive, negative, or neutral. |
Copied to clipboard
| Challenge: | sentiment knowledge is ignored in sentiment analysis, despite its use in pretraining. |
| Approach: | They propose to use sentiment knowledge to learn a unified sentiment representation for multiple sentiment analysis tasks. |
| Outcome: | The proposed method outperforms strong pre-training baseline on three kinds of sentiment tasks. |
Copied to clipboard
| Challenge: | Existing approaches to multimodal speech emotion recognition and sentiment analysis have not improved results due to their relatively simple fusion mechanisms and lack of proper cross-modal pretraining. |
| Approach: | They propose a deep-fused audio-text bi-modal transformer with carefully designed cross-modal fusion mechanism and stage-wise cross-mod pretraining scheme to facilitate cross-modulation. |
| Outcome: | The proposed method exceeds benchmarks on public IEMOCAP emotion and CMU-MOSEI sentiment datasets by a large margin. |
Copied to clipboard
| Challenge: | EMBYTE is a byte-level tokenization model that reduces embedding parameters by up to 94% . it is also resilient to privacy threats such as gradient inversion attacks . |
| Approach: | EMBYTE is a byte-level tokenization model that decomposes subwords into fine-grained byte embeddings and then compresses them via neural projection. |
| Outcome: | EMBYTE achieves substantial embedding compression while preserving accuracy and enhancing privacy. |
Copied to clipboard
| Challenge: | Negation detection is a complex linguistic phenomenon with long spans . existing methods tend to make wrong predictions around the scope boundaries . |
| Approach: | They propose a model which engages the Boundary Shift Loss to refine the predicted boundary. |
| Outcome: | The proposed model refines the predicted boundary on multiple datasets. |
Copied to clipboard
| Challenge: | Existing methods for online sentiment analysis rely on pre-existing datasets. |
| Approach: | They propose a co-training framework specifically designed for efficient sentiment analysis within dynamic data streams. |
| Outcome: | The proposed framework surpasses existing methods in terms of accuracy and computational efficiency. |
Copied to clipboard
| Challenge: | Existing models with span-based labeling have achieved promising results in sentiment analysis. |
| Approach: | They propose a shared-private representation model with a coarse-to-fine extraction algorithm to solve this problem. |
| Outcome: | The proposed model achieves state-of-the-art on target phrases and extraction tasks. |
Copied to clipboard
| Challenge: | Negation poses a challenge in many natural language understanding tasks . leveraging sentences with negation and affirmative interpretations is beneficial for many tasks involving humans . |
| Approach: | They propose to collect negated sentences and their affirmative interpretations and leverage them to build a plug-and-play neural generator that generates an affirmative interpreter. |
| Outcome: | The proposed method does not require manual effort and does not impact other tasks. |
Copied to clipboard
| Challenge: | Multi-task learning (MTL) is a machine learning paradigm where multiple learning tasks are optimized simultaneously, exploiting commonalities and differences across them. |
| Approach: | They propose a parameter-efficient MTL architecture to improve task aggregation and to include loosely related skills from multiple datasets. |
| Outcome: | The proposed architecture outperforms single-task learning (STL) and is expected to outperformed it. |
Copied to clipboard
| Challenge: | Existing annotation tools are desktop applications, allowing the annotation of corpora found on a single computer. |
| Approach: | They propose a new annotation paradigm, casual annotation, and propose an architecture and a reference implementation for the Ellogon Casual Annotation Tool. |
| Outcome: | The proposed paradigm and architecture have been evaluated for more than two years on an annotation task related to sentiment analysis. |
Copied to clipboard
| Challenge: | Existing studies treat all three modal features equally and implicitly explore the interactions between different modalities. |
| Approach: | They propose a text-centered shared-private framework for multimodal fusion . they propose modalities that can provide shared and private semantics . |
| Outcome: | The proposed framework outperforms baselines on the MOSEI and MOSI datasets. |
Copied to clipboard
| Challenge: | Sentiment Analysis is a subtask of Natural Language Processing. |
| Approach: | They propose a new, domain-neutral lexicon for sentiment analysis in English . they test it on two publicly available sentiment analysis datasets . |
| Outcome: | The proposed lexicon performs better than existing sentiment lexiconics on two publicly available datasets. |
Copied to clipboard
| Challenge: | Existing solutions to bridge the gap between resource-rich and resource-poor languages are being explored. |
| Approach: | They examine the feasibility of machine translation for creating sentiment analysis datasets in 22 Indian languages. |
| Outcome: | The proposed dataset can be used to tackle low-resource challenges in sentiment analysis for Indian languages. |
Copied to clipboard
| Challenge: | GRhOOT is a domain ontology of rhetorical figures in the German language . the goal is to allow for easier detection of non-literal language based tasks . |
| Approach: | GRhOOT is a domain ontology of 110 rhetorical figures in the german language . the goal is to allow for easier detection and sentiment analysis . |
| Outcome: | The ontology of rhetorical figures in the German language is based on 110 rhetorical figure domains . the goal is to make the ontologies more accurate and to allow for easier detection . |
Copied to clipboard
| Challenge: | Covid-19 infodemic has led to low quality information leading to poor health decisions . authors propose a framework for analyzing false claims and reasoning about the decisions a person makes . |
| Approach: | They propose a framework linking stance and reason analysis and moral sentiment analysis. |
| Outcome: | The proposed framework provides reliable predictions even in low-supervision settings. |
Copied to clipboard
| Challenge: | Code-switching is a common phenomenon in multilingual communities . however, sentiment analysis of code-switch data is elusive and unexplored . |
| Approach: | They propose to combine two transformers using logits of their output and feed them to a neural network for sentiment analysis. |
| Outcome: | The proposed system achieves an F1 score of 73.66% for English-Hi and 61.24% for English . it outperforms the best model reported for the GLUECoS benchmark dataset. |
Copied to clipboard
| Challenge: | Existing backdoor attacks are not stealthy to system deployers or users. |
| Approach: | They propose a novel backdoor attack method based on negative data augmentation and modifying word embeddings that is much stealthier while maintaining pretty good attacking performance. |
| Outcome: | The proposed method is much stealthier while maintaining pretty good attacking performance. |
Copied to clipboard
| Challenge: | Incorporating Item Response Theory (IRT) into NLP tasks can provide valuable information about model performance and behavior. |
| Approach: | They propose to use IRT models generated from artificial crowds of DNNs to learn IRT. |
| Outcome: | The proposed model learning method outperforms baseline methods for two NLP tasks. |
Copied to clipboard
| Challenge: | Existing work focuses on extracting aspect terms and opinion terms without considering the relations between aspect terms . |
| Approach: | They propose a task to extract aspect terms, opinion terms, and expressed sentiments from a two-dimensional (2D) table. |
| Outcome: | The proposed method achieves state-of-the-art on several public benchmarks and is well-suited to the ASTE task. |
Copied to clipboard
| Challenge: | DiaSet is a dataset of dialectical Arabic speech manually transcribed and annotated for two downstream tasks. |
| Approach: | They propose to manually transcribe and annotate Arabic speech for sentiment analysis and named entity recognition. |
| Outcome: | The proposed dataset encapsulates the Palestine dialect, predominantly spoken in Palestine, Israel, and Jordan. |
Copied to clipboard
| Challenge: | a diversity advanced actor-critical reinforcement learning framework is used to improve NLP generalization and accuracy. |
| Approach: | They introduce Diversity Advanced Actor-Critic reinforcement learning framework to improve NLP generalization and accuracy. |
| Outcome: | The proposed framework outperforms domain adaptation and generalization baselines without using any target domain knowledge. |
Copied to clipboard
| Challenge: | Existing methods to augment sentiment models have failed to mitigate spurious association problem inherent in the original data. |
| Approach: | They propose a framework for enhancing sentiment models using an antonymous paradigm and contrastive learning to generate high-quality samples. |
| Outcome: | The proposed framework achieves state-of-the-art performance on four benchmark datasets. |
Copied to clipboard
| Challenge: | despite large language models showing bias against non-mainstream varieties, there are no labeled datasets for sentiment analysis of English. |
| Approach: | They propose a benchmark for sentiment and sarcasm classification for three varieties of English . they manually annotate the datasets with sentiment and the sarcasmatic labels . |
| Outcome: | The proposed benchmark is based on a web-based content from Google Place reviews and Reddit comments. |
Copied to clipboard
| Challenge: | Subjectivity is the expression of internal opinions or beliefs which cannot be objectively observed or verified. |
| Approach: | They develop a dataset which investigates subjectivity in question answering . they find that subjectivity is an important feature in the case of QA . |
| Outcome: | The proposed dataset shows that subjectivity is an important feature in question answering (QA) it also shows that subjective questions and answers can have more complex interactions than previously thought. |
Copied to clipboard
| Challenge: | Existing methods for sentiment analysis on user reviews neglect their time-varying characteristics. |
| Approach: | They propose a dual-channel framework that models temporal user and product dynamics for sentiment analysis. |
| Outcome: | The proposed framework is superior to existing methods on five real-world datasets. |
Copied to clipboard
| Challenge: | Recent research in interpretability of neural models has yielded numerous token attribution techniques, but it is hard to evaluate whether these explanations are faithful. |
| Approach: | They propose to use pairwise attributions to connect outputs to high-level model behavior to examine how well different attribution techniques align with this assumption on realistic counterfactuals in the case of reading comprehension (RC). |
| Outcome: | The proposed methods are better suited to RC than token-level attributions across different RC settings, and the best performance comes from a modification that was proposed to an existing pairwise attribution method. |
Copied to clipboard
| Challenge: | Pre-trained transformer models have shown great success in improving performance on downstream tasks, but fine-tuning on a new task still requires large amounts of labeled data. |
| Approach: | They propose a method which allows optimization-based meta-learning across tasks . they use transformers to train transformer models and find better generalizations . |
| Outcome: | The proposed method outperforms self-supervised training and pre-trained models on 17 NLP tasks. |
Copied to clipboard
| Challenge: | Existing incomplete multimodal learning frameworks are inadequate for integrating multimodal data. |
| Approach: | They propose a framework for incomplete multimodal learning that is deficiency-resistant and provides two modules to address fine-grained deficiencies. |
| Outcome: | The proposed framework outperforms the SOTA models on two well-known multimodal benchmarks. |
Copied to clipboard
| Challenge: | a large number of end-to-end systems are needed for many tasks in natural language processing. |
| Approach: | They propose a continual few-shot learning task where a system is asked to correct mistakes with a few training examples. |
| Outcome: | The proposed task compares two NLI and one sentiment analysis datasets with baselines from diverse paradigms. |
Copied to clipboard
| Challenge: | Current researches on sentiment classification are shifting from improving model performance to interpretability. |
| Approach: | They propose a new tree form capable of interpreting sentiment composition in a principled way. |
| Outcome: | The proposed tree can explain sentiment composition in a principled way. |
Copied to clipboard
| Challenge: | Existing approaches to zero-shot learning are format-agnostic and can address new learning tasks without additional training. |
| Approach: | They propose a new paradigm for zero-shot learning that is format agnostic and compatible with any format and applicable to a list of language tasks. |
| Outcome: | The proposed model shows state-of-the-art performance on several benchmarks and produces satisfactory results on tasks such as text classification and commonsense reasoning. |
Copied to clipboard
| Challenge: | a global trend of misinformation is affecting non-native speaker users who are more susceptible to misinformation on foreign social media platforms. |
| Approach: | They propose a method to integrate sentiment analysis as an auxiliary task and a hierarchical routing strategy and expert-mask mechanism to enhance cross-lingual social misinformation detection. |
| Outcome: | The proposed method improves cross-lingual social misinformation detection in non-native speakers with only monolingual social media histories. |
Copied to clipboard
| Challenge: | EcoVerse is an annotated English Twitter dataset of 3,023 tweets . mainstream NLP tasks dominate the scene, but environmental impacts remain unstudied . |
| Approach: | They propose an annotation scheme for Eco-Relevance Classification, Stance Detection and an original approach for Environmental Impact Analysis. |
| Outcome: | The proposed scheme produces consistent annotations of high quality . the dataset is made freely available to stimulate further research . |
Copied to clipboard
| Challenge: | toxicity prediction and sentiment analysis models perpetuate undesirable social biases from the data on which they are trained. |
| Approach: | They propose to use toxicity prediction and sentiment analysis to examine whether NLP models perpetuate undesirable biases towards mentions of disability. |
| Outcome: | The proposed models contain undesirable biases towards mentions of disability in two English language models. |
Copied to clipboard
| Challenge: | bgGLUE is a benchmark for evaluating language models on natural language understanding (NLU) tasks in Bulgarian. |
| Approach: | They propose to use a benchmark to evaluate language models on NLU tasks in Bulgarian. |
| Outcome: | The proposed model performs well on sequence labeling tasks, but there is room for improvement for tasks that require more complex reasoning. |
Copied to clipboard
| Challenge: | Recent work has shown word-level embeddings reflect and propagate social biases present in training corpora. |
| Approach: | They propose a method to debias word embeddings to reduce biases at sentence level . they hope their work will inspire future research on characterizing and removing biase . |
| Outcome: | The proposed method reduces biases and preserves performance on downstream tasks such as sentiment analysis and natural language understanding. |
Copied to clipboard
| Challenge: | Existing few-shot learning methods focus on single-label predictions, which can not work well for ACD since a sentence may contain multiple aspect categories. |
| Approach: | They propose a few-shot learning method that uses the prototypical network to learn aspects from a set of aspects. |
| Outcome: | The proposed method significantly outperforms baseline methods on three datasets. |
Copied to clipboard
| Challenge: | Existing studies on adversarial attacks on deep learning models focus on generation of adversarials and defense against adversarial attacks. |
| Approach: | They propose a framework to identify and adjust malicious perturbations and block adversarial attacks for machine learning models. |
| Outcome: | The proposed framework outperforms baseline methods in blocking adversarial attacks for text classification models. |
Copied to clipboard
| Challenge: | Existing methods for domain adaptation from multiple sources are designed to transfer supervision from a single source domain. |
| Approach: | They propose to capture the relationship between a target example and different source domains by a point-to-set metric. |
| Outcome: | The proposed method outperforms baselines and can handle negative transfer. |
Copied to clipboard
| Challenge: | Recent studies have attempted to perform two tasks separately, e.g., target extraction and sentiment classification. |
| Approach: | They propose a hierarchical stack bidirectional gated recurrent units (HSBi-GRU) model which allows the target label to influence their sentiment label. |
| Outcome: | The proposed model outperforms baseline models on two datasets and shows that it can learn abstract features. |
Copied to clipboard
| Challenge: | Sentiment lexica are vital for sentiment analysis in absence of document-level annotations . linguistic resources are limited for at least a few hundred languages, putting them at risk of extinction . |
| Approach: | They introduce UniSent universal sentiment lexica for 1000+ languages . they use a Bible corpus to project sentiment information from English to other languages based on Twitter data . |
| Outcome: | The proposed method mitigates domain mismatch between Bible and Twitter by using embeddings . it compares to other sentiment seeding methods in a subset of languages with ground truth available . |
Copied to clipboard
| Challenge: | Existing research on sentiment analysis based on eye movement signals has been attributed importance. |
| Approach: | They propose a linguistic probing eye movement paradigm to extract eye movement features based on the relationship between linguistic features and human reading behavior. |
| Outcome: | The proposed graph architecture achieves state-of-the-art performance on two sentiment analysis datasets with eye movement signals and three sentiment analysis data without eye movement signal. |
Copied to clipboard
| Challenge: | Earnings conference calls contain over 5,000 words of text and large amounts of industry jargon . this length and domain-specific language present problems for generic pretrained language models. |
| Approach: | They propose a task of predicting earnings surprises from earnings call transcripts and propose linguistic models that use a long document dataset to test financial understanding. |
| Outcome: | The proposed model can predict earnings surprises from earnings conference calls with reasonable accuracy and shows that it is possible to interpret the data with different interpretability methods. |
Copied to clipboard
| Challenge: | SlovakBERT is a new masked language model that is based on a Web-crawled corpus. |
| Approach: | They introduce a new Slovak-only transformers-based language model called SlovkBERT . they evaluate the model on several NLP tasks and establish a benchmark for Slovakia . |
| Outcome: | The proposed model achieves state-of-the-art on several NLP tasks and achieves best results . the proposed model could be used by other Slovak researchers or NLP practitioners . |
Copied to clipboard
| Challenge: | Contextualized word representations are effective in downstream tasks such as question answering, named entity recognition, and sentiment analysis. |
| Approach: | They propose to integrate pre-trained contextualized word representations into a neural network that captures the whole sentence and the word representation in the sentence. |
| Outcome: | The proposed approach outperforms the state-of-the-art approach that makes use of non-contextualized word embeddings on multiple benchmark WSD datasets. |
Copied to clipboard
| Challenge: | Sentiment analysis models often fail to capture the broader complexities of sentiment analysis. |
| Approach: | They propose a task to evaluate sentiment understanding through two subtasks . they annotate a new dataset comprising 15,028 statements from 3,638 reviews . |
| Outcome: | The proposed task evaluates sentiment understanding through two subtasks . it is a challenging task for both small and large language models, with performance gaps of up to 27% . |
Copied to clipboard
| Challenge: | Specifically, we explore the advantage of counterfactual reasoning, over associative reasoning . Adding human supervision to attention has been shown to improve model predictions and explanations . |
| Approach: | They propose to use machine-augmented human attention supervision to enhance model quality. |
| Outcome: | The proposed method is more effective than existing methods requiring higher annotation cost . the proposed method can be trained to generate similar attention to human supervision . |
Copied to clipboard
| Challenge: | Existing research efforts focus on targeting sentiment analysis as a sequence labeling problem, building models that can capture explicit structures in the output space. |
| Approach: | They argue that both implicit and explicit structural information are crucial for building a successful targeted sentiment analysis model. |
| Outcome: | The proposed model outperforms existing models by capturing implicit and explicit structural information. |
Copied to clipboard
| Challenge: | a sub-field of word recognition models is emerging to combat adversarial spelling mistakes . imperceptible attacks can cause models to misclassify examples, but training robust models remains a challenge . |
| Approach: | They propose to place a word recognition model in front of a downstream classifier to combat adversarial spelling mistakes. |
| Outcome: | The proposed model outperforms adversarial training and off-the-shelf spell checkers in a word recognition task. |
Copied to clipboard
| Challenge: | Existing methods to detect sarcasm target with text lacking context are not sufficient and complete. |
| Approach: | They propose a multi-modal sarcasm target identification task that performs both textual and visual detection. |
| Outcome: | The proposed model can perform textual target labeling and visual target detection. |
Copied to clipboard
| Challenge: | Existing models for text classification have largely ignored convolution filters and max pooling . text classification is one of the major applications of natural language processing . |
| Approach: | They propose a convolutional attentive recurrent network model which uses convolution filters and max pooling to improve text classification. |
| Outcome: | The proposed model outperforms existing convolutional models on text classification tasks. |
Copied to clipboard
| Challenge: | XED is a multilingual fine-grained emotion dataset for English and other low-resource languages. |
| Approach: | They propose a multilingual fine-grained emotion dataset using Plutchik's Wheel of Emotions and a projection scheme to annotate Finnish and English sentences. |
| Outcome: | The proposed dataset is based on human-annotated Finnish and English sentences and projected annotations for 30 additional languages. |
Copied to clipboard
| Challenge: | Recent abstractive approaches generate KPs based on sentences, resulting in overlapping and hallucinated opinions. |
| Approach: | They propose to use supervised learning to extract short sentences as key points before matching them to review comments for quantification of KP prevalence. |
| Outcome: | The proposed framework achieves state-of-the-art performance on Yelp and SPACE. |
Copied to clipboard
| Challenge: | Existing pre-trained language models learn contextualized representations by using unlabeled text data and obtain state of the art results on a multitude of NLP tasks. |
| Approach: | They propose a pre-trained BERT model for Romanian language processing and compare it with multi-lingual models on seven Romanian specific NLP tasks. |
| Outcome: | The proposed model outperforms multi-lingual models on seven Romanian specific NLP tasks on sentiment analysis, dialect and cross-dialect topic identification, and diacritics restoration. |
Copied to clipboard
| Challenge: | specialized embeddings are not available for tasks like entity linking or paragraph classification. |
| Approach: | They evaluate whether universal embeddings can be complemented by specialized embeddables. |
| Outcome: | The proposed embeddings outperform state-of-the-art embeddables without any fine-tuning. |
Copied to clipboard
| Challenge: | a new set of word embeddings is released to improve word embedment performance . word embeds provide useful representations of meanings of words in vectors . |
| Approach: | They present a set of word embeddings trained on Urban Dictionary . they show they have high performance across a range of common word embeding evaluations . |
| Outcome: | The first set of word embeddings trained on Urban Dictionary has high performance . the embeddables perform better on a range of common word evaluation tasks . |
Copied to clipboard
| Challenge: | Traditional neural network models represent word senses as vectors that are uninterpretable for humans. |
| Approach: | They propose a framework that incorporates word Sense Disambiguation (WSD) by identifying and paraphrasing ambiguous words to improve sentiment predictions. |
| Outcome: | The proposed framework improves sentiment analysis accuracy and interpretability on a downstream task without ground-truth word sense labels. |
Copied to clipboard
| Challenge: | Existing general purpose components for learning differentiable windows are hard to optimize. |
| Approach: | They propose a new neural module and general purpose component for dynamic window selection that can enable more focused attentions over the input regions. |
| Outcome: | The proposed approach improves on a myriad of NLP tasks including machine translation, sentiment analysis, subject-verb agreement and language modeling. |
Copied to clipboard
| Challenge: | Previously studies focused on semantic tasks such as sentiment analysis, question answering and reading comprehension. |
| Approach: | They propose two approaches to study where and how adversarial examples exist in dependency parsing . they use a state-of-the-art parser to find adversarials in existing texts . |
| Outcome: | The proposed approaches show that adversarial examples exist in dependency parsing . they show that up to 77% of input examples admit adversarials . |
Copied to clipboard
| Challenge: | Existing systems for natural language understanding (NLU) are limited due to the inherent ambiguity and incompleteness inherent in natural language. |
| Approach: | They propose a system to extract tasks from natural language instructions and map them to robots' established collection of skills. |
| Outcome: | The proposed system outperforms baseline models in the training and evaluation of a dataset featuring complex instructions. |
Copied to clipboard
| Challenge: | Existing research results on explicit sentiment analysis are limited . implicit sentiment analysis is a process of analyzing text based on whether it contains explicit sentiment words. |
| Approach: | They propose a model that integrates external knowledge and contextual features . they use a knowledge graph to supplement implicit sentiment expression . |
| Outcome: | The proposed model can achieve better results on the SMP2019 implicit sentiment analysis dataset. |
Copied to clipboard
| Challenge: | Existing algorithms and tools for sentiment analysis are lacking in dealing with Arabic metaphorical expressions. |
| Approach: | They propose to use Arabic metaphors in automatic Arabic sentiment analysis to examine the performance of a state-of-art Arabic sentiment tool on metaphors. |
| Outcome: | The proposed model outperforms the state-of-the-art sentiment analysis tool on metaphors and gain a deeper insight into the issue. |
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have led to their adoption across a wide range of tasks, ranging from code generation to machine translation and sentiment analysis. |
| Approach: | They propose to fine-tune LLMs on benign (non-harmful) data to ensure safe outputs. |
| Outcome: | The proposed model reduces attack success rates across a range of tasks without compromising its usefulness. |
Copied to clipboard
| Challenge: | Existing neural models struggle with implicit sentiment analysis because they latch onto spurious correlations, resulting in poor generalization and robustness. |
| Approach: | They propose a CausaL intervention model for implicit sEntiment ANalysis using instrumental variable to eliminate confounding causal effects and extract the pure causal effect between sentence and sentiment. |
| Outcome: | The proposed model extracts the pure causal effect between sentence and sentiment using instrumental variable. |
Copied to clipboard
| Challenge: | Existing methods for opinion mining and sentiment analysis focus on extracting either positive or negative opinions from texts and determining the targets of these opinions. |
| Approach: | They propose a corpus-based scheme that detects evaluative language at a finer-grained level. |
| Outcome: | The proposed scheme classifies each sentence into one of four evaluation types based on the proposed scheme. |
Copied to clipboard
| Challenge: | Existing methods for predicting sentiment polarity of aspects are susceptible to interference caused by irrelevant contexts and lack sentiment knowledge at a data-specific level. |
| Approach: | They propose a novel Aspect-based sentiment analysis method that leverages attention scores to model the relationships between aspects and contexts. |
| Outcome: | The proposed method is able to predict sentiments from a set of five benchmark datasets. |
Copied to clipboard
| Challenge: | Existing approaches to Aspect-Based Sentiment Analysis (ABSA) are lacking in a comprehensive evaluation and fair comparison. |
| Approach: | They propose to use a knowledge-mining method to build a large-scale knowledge-annotated SPT corpus and integrate sentiment knowledge into pre-training. |
| Outcome: | The proposed method is able to build a large-scale knowledge-annotated SPT corpus and compares with other methods. |
Copied to clipboard
| Challenge: | Aspect Based Sentiment Analysis (ABSA) is a finer level sentiment analysis that assigns polarity to each targeted aspect instead of the entire review. |
| Approach: | They propose to use Telugu as a language for aspect based sentiment analysis . they use a resource that can be used to classify and categorise aspects of a review . |
| Outcome: | The proposed resource is based on a set of tasks in Telugu which demonstrate its reliability and usefulness. |
Copied to clipboard
| Challenge: | Debate transcripts from the UK Parliament contain information about the positions taken by politicians towards important topics, but are difficult for humans to process manually. |
| Approach: | They propose to use a linear classifier and a transformer word embedding model to classify sentiment polarity in debate speeches to evaluate sentiment analysis systems for the political domain. |
| Outcome: | The proposed method performs better on the largest dataset and is more robust to other datasets. |
Copied to clipboard
| Challenge: | Existing methods to obtain text representations or embeddings with these models encoding personally identifiable information may lead to privacy leaks. |
| Approach: | They propose a novel approach which combines differential privacy and adversarial learning to preserve privacy during training of embeddings. |
| Outcome: | The proposed approach reduces private information leakage by 3% over the current method. |
Copied to clipboard
| Challenge: | Aspect term extraction is a task to extract aspect terms from review texts as opinion targets for sentiment analysis. |
| Approach: | They propose a conditional generation task for augmentation of aspect term extraction . they use a sequence-to-sequence method that generates a new sentence . results confirm that their method alleviates the data scarcity problem significantly . |
| Outcome: | The proposed method reduces the data scarcity problem significantly and boosts current models. |
Copied to clipboard
| Challenge: | In-context learning (ICL) is an emerging ability of large-scale labeled data for document-level event argument extraction (EAE). |
| Approach: | They propose an explicit heuristic-driven demonstration construction approach that emphasizes task heurs in document-level event argument extraction tasks. |
| Outcome: | The proposed method outperforms existing prompting methods and few-shot supervised learning methods on document-level EAE datasets. |
Copied to clipboard
| Challenge: | Sentiment analysis is a popular area of Natural Language Processing due to its subjective and semantic characteristics. |
| Approach: | They propose to annotate Brazilian Portuguese sentences manually using a sentiment corpus . they run experiments on polarity classification using six machine learning classifiers . |
| Outcome: | The proposed method is based on a Brazilian Portuguese sentiment corpus and achieved 80.38% on F-Measure and 64.87% when including the neutral class. |
Copied to clipboard
| Challenge: | Backdoor attacks are a serious threat to the safety of reusing deep neural networks (DNNs). |
| Approach: | They propose an efficient online defense mechanism based on robustness-aware perturbations to distinguish poisoned and clean samples to defend against backdoor attacks on natural language processing models. |
| Outcome: | The proposed method achieves better defending performance and lower computational costs than existing defense methods. |
Copied to clipboard
| Challenge: | The Norwegian Review Corpus is a dataset of full-text reviews from major news sources. |
| Approach: | This paper presents the Norwegian Review Corpus, created for document-level sentiment analysis. |
| Outcome: | The corpus comprises more than 35,000 full-text reviews from a range of different domains. |
Copied to clipboard
| Challenge: | sentiment analysis has seen an explosive expansion over the last decade or so . many theoretical and methodological questions remain unanswered and resource gaps unfilled . |
| Approach: | They develop a sentiment lexicon for written (standard) Swedish using an existing dataset . they assign a real value sentiment score in the range [-1,1] and produce a label for it . |
| Outcome: | The proposed sentiment lexicon is an open source resource from the Swedish Language Bank . it is based on an existing gold standard dataset and is available from Sprkbanken . |
Copied to clipboard
| Challenge: | Pretrained language models (PLMs) have achieved competitive performance on a range of NLP tasks. |
| Approach: | They propose to learn distributional invariance across source domains via alignment regularization loss functions to improve domain generalization by prompting. |
| Outcome: | Experiments on sentiment analysis and natural language inference show the effectiveness of the proposed method and achieve state-of-the-art results. |
Copied to clipboard
| Challenge: | Marathi is the third most widely spoken language in India with over 83 million native speakers . available Marath datasets are limited to coarse sentiment labels and lack fine-grained emotional categorization or interpretability through explanations. |
| Approach: | They propose to annotate Marathi sentences labeled with sentiment, emotion and a corresponding natural language justification. |
| Outcome: | The proposed dataset provides a benchmark for future research in multilingual and explainable NLP. |
Copied to clipboard
| Challenge: | Current methods for extracting opinion words for an aspect in text leverage position embeddings to capture relative position of word to the target. |
| Approach: | They propose to use pretrained word embeddings to extract opinion words for a given aspect in text. |
| Outcome: | The proposed methods outperform current methods on a task based on pre-trained word embeddings and position embedders. |
Copied to clipboard
| Challenge: | Prompt-based learning is susceptible to intrinsic bias present in pre-trained language models (LMs), leading to sub-optimal performance in prompt-based zero/few-shot settings. |
| Approach: | They propose a null-input prompting method to calibrate intrinsic bias encoded in pre-trained language models (LMs) they leverage a diverse set of auto-selected null meaning inputs generated from GPT-4 to probe intrinsic bias. |
| Outcome: | The proposed method significantly improves zero/few-shot learning performance of LMs for both in-context learning and prompt-based fine-tuning (on average 9% and 2%, respectively). |
Copied to clipboard
| Challenge: | Code-mixed text presents significant challenges for machine learning due to interplay of distinct grammatical structures, effectively forming a hybrid language. |
| Approach: | They propose a Hybrid Language Model that combines a multilingual encoder and a lightweight decoder to achieve sentiment classification performance comparable to those of fine-tuned Large Language Models. |
| Outcome: | The proposed model outperforms models trained individually in sentiment detection tasks. |
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis (ABSA) has not been explored in the Japanese language . there is no standard Japanese dataset available for ABSA task in the language - a paper by cnn. |
| Approach: | They propose to use a Japanese aspect-based sentiment analysis dataset for hotel reviews domain . they propose to include 53,192 review sentences with seven aspect categories and two polarity labels . |
| Outcome: | The proposed dataset contains 53,192 review sentences with seven aspect categories and two polarity labels. |
Copied to clipboard
| Challenge: | BERT models are often taken off-the-shelf and fine-tuned on a downstream task. |
| Approach: | They propose an extra stage of self-supervised task-adaptive pre-training to perform a task on a number of Croatian-supporting Transformer models. |
| Outcome: | The proposed approach improves performance across multilingual models but not in Croatian-dominant models. |
Copied to clipboard
| Challenge: | Existing systems for sentiment analysis are focused on document and sentence levels, but there are no public datasets on aspect-based sentiment analysis for Farsi. |
| Approach: | They propose to use a manually annotated Farsi dataset to analyze the opinion polarity of reviews . they also use transfer learning to analyze aspects of the review to improve their results . |
| Outcome: | The proposed method performs better than other aspects of the existing system. |
Copied to clipboard
| Challenge: | Social media platforms such as Twitter and Facebook are a new channel of information dissemination for many negative groups for recruitment. |
| Approach: | They propose to use a social media sentiment analysis corpus annotated with the sentiment classes positive, negative and neutral to investigate the polarity of user-expressed opinions. |
| Outcome: | The proposed model is based on a set of benchmark datasets for sentiment analysis across a range of domains and languages. |
Copied to clipboard
| Challenge: | despite the abundance of Turkish speakers, linguistic resources for natural language processing remain scarce. |
| Approach: | They propose a set of freely available linguistic resources for Turkish natural language processing . they provide corpora and pretrained models to help practitioners build their own applications . |
| Outcome: | The proposed linguistic resources are first of their kind and easy to use in a broad range of implementations. |
Copied to clipboard
| Challenge: | Existing multilingual Large Language Models are not specifically trained with objectives for managing code-switching scenarios. |
| Approach: | They propose to use multilingual Large Language Models to perform sentiment analysis, machine translation, summarization and word-level language identification to compare their performance to fine-tuned models of much smaller scales. |
| Outcome: | The proposed models show that they underperform in comparison to fine-tuned models of much smaller scales. |
Copied to clipboard
| Challenge: | Existing ASQP datasets are small and low-density, hindering technical advancement . et al. (2017): aspect sentiment quad prediction provides a complete aspect-level sentiment structure. |
| Approach: | They propose a one-step solution for Aspect sentiment quad prediction that can detect aspect categories and identify aspectopinion-sentiment triplets simultaneously. |
| Outcome: | The proposed solution can detect aspect categories and identify aspectopinion-sentiment triplets simultaneously. |
Copied to clipboard
| Challenge: | Large language models generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. |
| Approach: | They propose to use a teacher model to label LLM generations and use their label probabilities to identify a representative subset of diverse generations that boost zero-shot accuracies while being efficient. |
| Outcome: | The proposed models generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. |
Copied to clipboard
| Challenge: | Existing methods for multi-modal sentiment analysis have been developed to overcome these challenges. |
| Approach: | They propose a method that utilizes a masking technique as the bottleneck for information filtering and integrates all modalities into a common feature space via domain adaptation. |
| Outcome: | Extensive experiments on two benchmark MSA datasets show the proposed method performs better than baselines. |
Copied to clipboard
| Challenge: | a growing body of research focused on using language to give instructions, supervision and even inductive biases to models instead of relying exclusively on labeled examples. |
| Approach: | They explore natural language patches that provide corrective feedback at the right level of abstraction. |
| Outcome: | The proposed model improves accuracy on real data by 1–4 accuracy points on different slices of a sentiment analysis dataset and F1 by 7 points on a relation extraction dataset. |
Copied to clipboard
| Challenge: | Existing corpus for sentiment analysis uses text inputs, but voice inputs are becoming more important as smart assistants and mobile voice control become more prevalent. |
| Approach: | They propose to extend the Switchboard-1 Telephone Speech Corpus by adding sentiment labels from 3 different human annotators for every transcript segment. |
| Outcome: | The proposed corpus contains 49500 labeled speech segments covering 140 hours of audio. |
Copied to clipboard
| Challenge: | Existing models for argument mining are limited in interpreting future-oriented arguments. |
| Approach: | They propose a categorization of argument units into claims, premises, and scenarios coupled with a unique sentiment analysis framework. |
| Outcome: | The proposed framework outperforms existing models in most tasks and is more efficient than existing methods. |
Copied to clipboard
| Challenge: | Researchers have traditionally recruited native speakers to provide annotations for benchmark datasets, but there are languages for which recruiting native speakers is difficult. |
| Approach: | They recruit 36 language learners and provide two types of additional resources and perform mini-tests to measure their language proficiency. |
| Outcome: | The proposed method improves learners' language proficiency in terms of vocabulary and grammar. |
Copied to clipboard
| Challenge: | Traditional sentiment analysis methods focus on static reviews, failing to capture temporal relationship between user sentiment rating and textual content. |
| Approach: | They propose a dynamic graph-based framework that addresses data sparsity in streaming reviews. |
| Outcome: | The proposed framework reduces data sparsity by categorizing users into mid-tail, long-tail and extreme scenarios and incorporating LLM enhancements within a dynamic graph-based structure. |
Copied to clipboard
| Challenge: | Domain adaptive pre-training and task-adaptive pre- training (TAPT) are popular methods to reduce this bias for low-resource languages, but they have not been explored for African multilingual encoders. |
| Approach: | They propose a large-scale social media and news domain corpus for continual pre-training on African languages. |
| Outcome: | The proposed methods improve performance on three subjective tasks, including sentiment analysis, multi-label emotion, and hate speech classification, while TAPT improves performance on other related tasks. |
Copied to clipboard
| Challenge: | Africa has the highest linguistic diversity among all continents. |
| Approach: | They introduce a sentiment analysis benchmark that contains >110,000 tweets in 14 African languages . they describe the data collection methodology, annotation process, and challenges . |
| Outcome: | The proposed dataset contains >110,000 tweets in 14 African languages . the tweets were annotated by native speakers and used in the shared task . |
Copied to clipboard
| Challenge: | Existing approaches for information extraction (IE) are limited by the number of subtasks and the isolation of the subtask. |
| Approach: | They propose a new paradigm for universal information extraction that is compatible with any schema format and applicable to a list of IE tasks. |
| Outcome: | The proposed framework outperforms generative universal IE models on 14 benchmarks with the supervised setting and the state-of-the-art performance in low-resource scenarios. |
Copied to clipboard
| Challenge: | Prior work has shown that sentiment is encoded linearly in LLM representations, but their ability to utilize this information remains fragile to prompt variations. |
| Approach: | They propose a simple inference-time intervention method that amplifies circuit features to compensate for insufficient activation. |
| Outcome: | The proposed method improves on a sentiment analysis circuit with sparse autoencoders and circuit-level analysis. |
Copied to clipboard
| Challenge: | Existing models for speech emotion recognition are not suitable for emotional tasks. |
| Approach: | They propose a universal speech emotion representation model that is pre-trained on open-source emotion data. |
| Outcome: | euphoria2vec outperforms state-of-the-art models and emotion specialist models . it shows consistent improvements among 10 different languages of speech emotion recognition datasets . |
Copied to clipboard
| Challenge: | Pun memes combine wordplay with visual elements to create humor, irony, or other rhetorical effects. |
| Approach: | They propose a benchmark to assess Chinese pun memes' processing capabilities across three progressive tasks: pun meme detection, sentiment analysis, and chat-driven meme response. |
| Outcome: | The proposed model can detect pun memes, analyze sentiments, and respond to chats, while ignoring homophone wordplay. |
Copied to clipboard
| Challenge: | Existing studies on sentiment analysis of tweets focus on the English language . however, there is still a challenge of processing lower-resourced languages . |
| Approach: | They transform tweet sentiment dataset into a multimodal format through a straightforward curation process. |
| Outcome: | The proposed approach performs exceptionally well in unimodal and multimodal configurations. |
Copied to clipboard
| Challenge: | Existing studies have focused on emphatic and expressive language models with informal styles, such as memes and emojis. |
| Approach: | They propose a two-stage Explainable Instruction Tuning framework that can improve LLMs' performance and explainability for RLF with limited samples. |
| Outcome: | The proposed framework can match zero-shot GPT-4 in performance but not explainability for RLF with limited samples. |
Copied to clipboard
| Challenge: | Aspect-Category based sentiment analysis is a fine-grained task to identify the sentiment polarities of pre-defined categories in text. |
| Approach: | They propose a MAjority Rules Guided for understanding the semantic difference between text and people. |
| Outcome: | The proposed model outperforms the state-of-the-art models on four benchmark datasets by 2.43% to 67.68% in terms of F1-score and by 1.16% to 10.22% in terms accuracy. |
Copied to clipboard
| Challenge: | Previous work has found that, in some settings, ICL performance is minimally affected by using demonstrations with irrelevant label words. |
| Approach: | They hypothesize that large language models (LMs) perform in-context learning from a handful of demonstrations via two sequential processes: an inference function that solves the task and a verbalization function that maps the inferred answer to the label space. |
| Outcome: | The proposed model can be localized in specific layers across open-source models, including GEMMA-7B, MISTRAL-7B-V0.3, GEIMA-2-27B, and LLAMA-3.1-70B. |
Copied to clipboard
| Challenge: | Existing methods for metaphor detection rely on heuristics such as Metaphor Identification Procedure (MIP) and Selection Preference Violation (SPV). |
| Approach: | They propose a cognitively motivated module that leverages the cognitive information of embodiment that can be derived from word embeddings and explicitly models the process of sensorimotor change that has been demonstrated as essential for metaphor processing. |
| Outcome: | The proposed module can improve metaphor detection compared with the heuristic MIP that has been applied previously. |
Copied to clipboard
| Challenge: | Existing studies on complaint identification are limited to text. |
| Approach: | They propose a meta-learning-based multi-modal multi-task framework for identifying complaints using emotion recognition and sentiment analysis as auxiliary tasks. |
| Outcome: | The proposed framework outperforms baselines and state-of-the-art approaches in centralized and federated meta-learning settings. |
Copied to clipboard
| Challenge: | Existing studies on integrating online community to solve social problems have not fully utilized these three components and the relationship among them. |
| Approach: | They propose a framework that simultaneously considers communities, users, and texts and can easily connect with a variety of downstream tasks related to social media. |
| Outcome: | The proposed model can be used to perform violation detection, sentiment analysis, and community recommendation across multiple tasks. |
Copied to clipboard
| Challenge: | Existing methods treat the Universum class equally with the classes of interest, leading to problems such as overfitting, misclassification, and diminished model robustness. |
| Approach: | They propose a closed boundary learning method that applies closed decision boundaries to classes of interest and designates the area outside all closed boundaries as the Universum class. |
| Outcome: | The proposed method improves accuracy and robustness of classification models on six state-of-the-art tasks. |
Copied to clipboard
| Challenge: | Prior approaches to synthesis use few-shot prompting, which relies on the LLM’s parametric knowledge to generate usable examples. |
| Approach: | They propose to use a dataset to generate examples of each label from the LLM. |
| Outcome: | The proposed model significantly improves lexical and semantic diversity, similarity to human-written text, and distillation performance, when compared to 32-shot prompting and four prior approaches. |
Copied to clipboard
| Challenge: | Recent efforts to develop lightweight and practical sentiment analysis models are limited by manual instruction and large-scale user texts. |
| Approach: | They propose a framework for sentiment analysis that uses attribute-based instruction construction and difficulty-based data filtering to distill knowledge. |
| Outcome: | The proposed framework outperforms baseline methods in data efficiency and performance. |
Copied to clipboard
| Challenge: | Aspect-Sentiment Triplet Extraction (ASTE) is one of the most challenging and complex tasks in sentiment analysis. |
| Approach: | They propose to use customer opinions of hotels and purchased products in Polish to extract ASTE triplets that contain an aspect, its associated sentiment polarity, and an opinion phrase that serves as a rationale for the assigned polarities. |
| Outcome: | The proposed datasets contain customer opinions about hotels and purchased products expressed in Polish and are available under a permissive licence and have the same file format as the English datasets. |
Copied to clipboard
| Challenge: | Recent studies demonstrate that large language models exhibit remarkable capabilities and achieve state-of-the-art performance in diverse sentiment analysis tasks. |
| Approach: | They propose a distillation framework that decouples knowledge from alignment and introduces a sentiment analysis benchmark that covers a diverse set of tasks. |
| Outcome: | The proposed framework improves models' generalization to unseen tasks and their generalization is strong against existing small-scale models. |
Copied to clipboard
| Challenge: | Recent advances in the education domain have provided new opportunities for solving interesting, but difficult problems. |
| Approach: | They propose to use EduSenti to fine-tune language models for assigning sentiment to reviews of educators' performance annotated for sentiment, emotion and educational topic. |
| Outcome: | The proposed model is compared with an Albanian masked language trained model from the last XLM-RoBERTa checkpoint and shows that it is a good fit for the proposed model. |
Copied to clipboard
| Challenge: | Limited availability of multilingual text corpora for pretraining results in poor performance on downstream tasks due to undertrained representation spaces for languages other than English. |
| Approach: | They propose a method that integrates source and target language representations within low-rank (LoRA) adapters using lightweight linear transformations to enhance representation quality and transfer performance for languages other than English. |
| Outcome: | The proposed method improves representation quality and performance for languages other than English while maintaining parameter efficiency. |
Copied to clipboard
| Challenge: | Experimental results show that Active Learning methods ignore example groups whose prevalence may vary . supervised fine-tuning remains a critical component of model development, authors say . |
| Approach: | They propose an approach that uses interpolations to create anchors between examples . they propose to use the model to identify informative examples that counteract shortcuts . |
| Outcome: | The proposed model outperforms state-of-the-art active learning methods on six datasets . it prioritizes high-certainty instances that integrate representations from different example groups . |
Copied to clipboard
| Challenge: | sentiment analysis is used to identify emotional aspects of texts but is limited by its small size and limited range of emotions. |
| Approach: | They propose a Korean sentiment analysis corpus that is limited by its small size and narrow range of emotions . they propose to fine-tune the KOTE dataset and analyze the results for social discrimination . |
| Outcome: | The proposed dataset includes 50,000 Korean online comments, each manually labeled for 43 emotions and NO EMOTION. |
Copied to clipboard
| Challenge: | Recent performance of Large Language Models (LLMs) in low-resource languages is under-researched due to resource constraints. |
| Approach: | They present a manually annotated dataset encompassing 33,606 Bangla tweets and Facebook comments. |
| Outcome: | The proposed model outperforms other models even in zero and few-shot scenarios. |
Copied to clipboard
| Challenge: | Large Language Models inherit stereotypes from their pretraining data, leading to biased behavior toward certain social groups in many tasks. |
| Approach: | They propose to annotate posts in pre-existing stance detection datasets with dialect or vernacular of a specific group and text complexity/readability to investigate whether these attributes influence the model’s stance detect decisions. |
| Outcome: | The proposed model exhibits significant stereotypes when performing stance detection tasks in a zero-shot setting. |
Copied to clipboard
| Challenge: | Misinformation evolves as it spreads, shifting in language, framing, and moral emphasis to adapt to new audiences. |
| Approach: | They propose a multi-round, persona-conditioned framework that simulates how claims are iteratively reinterpreted by agents with distinct ideological perspectives. |
| Outcome: | The proposed framework generates persona-specific claims across multiple rounds . it is based on an uncensored large language model and is scalable to multiple tasks . |
Copied to clipboard
| Challenge: | Current safety alignment methods fail to identify intended benign task before refusing to respond. |
| Approach: | They propose a method that uses inference-time trajectory-shifting to guide model behavior . they show that LLMs persist in refusing inputs containing harmful content . |
| Outcome: | The proposed approach reduces over-refusals with minimal impact on utility. |